-- Logs begin at Wed 2022-05-11 17:47:57 UTC, end at Wed 2022-05-11 19:17:14 UTC. -- May 11 18:42:56.622390 dv-cinder-755101-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 11 18:42:56.629785 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 18:42:56 2022] *** May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: nodename: dv-cinder-755101-8-iscsi May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: machine: x86_64 May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: clock source: unix May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: pcre jit disabled May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: detected number of CPU cores: 4 May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: current working directory: / May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: detected binary path: /usr/bin/uwsgi-core May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: your processes number limit is 47680 May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: your memory page size is 4096 bytes May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: detected max file descriptor number: 2048 May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: lock engine: pthread robust mutexes May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: thunder lock: enabled May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 11 18:42:56.635059 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 18:42:56.679148 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: Python main interpreter initialized at 0x55b430d3d9c0 May 11 18:42:56.679148 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: python threads support enabled May 11 18:42:56.679148 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: your server socket listen backlog is limited to 100 connections May 11 18:42:56.679148 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: your mercy for graceful operations on workers is 90 seconds May 11 18:42:56.679612 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: mapped 403077 bytes (393 KB) for 2 cores May 11 18:42:56.679612 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: *** Operational MODE: preforking *** May 11 18:42:56.679887 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: *** uWSGI is running in multiple interpreter mode *** May 11 18:42:56.679887 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: spawned uWSGI master process (pid: 79843) May 11 18:42:56.680107 dv-cinder-755101-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 11 18:42:56.680714 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: spawned uWSGI worker 1 (pid: 79852, cores: 1) May 11 18:42:56.683334 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: spawned uWSGI worker 2 (pid: 79853, cores: 1) May 11 18:42:56.683334 dv-cinder-755101-8-iscsi devstack@keystone.service[79843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 18:43:02.450016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:43:02.450016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: from cryptography.utils import int_from_bytes May 11 18:43:02.451422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:43:02.451422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: from cryptography.utils import int_from_bytes May 11 18:43:02.461267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:43:02.461267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: from cryptography.utils import int_from_bytes May 11 18:43:02.463133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 18:43:02.463133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: from cryptography.utils import int_from_bytes May 11 18:43:02.502596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 18:43:02.502788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 18:43:02.502976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] command line args: [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 18:43:02.503226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 18:43:02.503430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ================================================================================ {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 18:43:02.503672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] admin_token = **** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.503921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] config_dir = [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.504110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.504294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] config_source = [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.504477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] debug = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.504679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] list_limit = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] log_config_append = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] log_dir = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] log_file = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507516 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507516 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507516 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.507758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.508321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.508321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.508488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.508953 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.508953 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.509481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.509481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.510099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.510099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.510099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.510941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.510941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] publish_errors = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.510941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.512044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.512044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.512044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.512044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.512044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] standard_threads = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.513173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.513173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.513173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.513173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] use_journal = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.513173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] use_json = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.513173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] use_stderr = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.514042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] use_syslog = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.514042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.514042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.514042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.514546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 18:43:02.514720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.514861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 18:43:02.514861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] command line args: [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 18:43:02.515109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.515237 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 18:43:02.515392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.515533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ================================================================================ {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 18:43:02.515669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.515813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] admin_token = **** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.515947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.516113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] config_dir = [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.516244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.516382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.516521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.516649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] config_source = [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.516793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.516921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] debug = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.516921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.517194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.517328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.517467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.517595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.517728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.517728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.517983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.518117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.518244 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.518447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.518590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] list_limit = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.518753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.518919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] log_config_append = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.519047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.519181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.519181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] log_dir = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.519477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.519606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] log_file = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.519739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.519868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.519996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.520131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.520264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.520392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.520524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.520652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.520783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.520927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.521077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.521207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.521341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.521469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.521604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.521733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.521866 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.522001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.522129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.522743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.522882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.523012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.523139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.523283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.523457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.523587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.523791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.523791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.524037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.524169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.524169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.524432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.524568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.524568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.524568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.524568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.525051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.525189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.525323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] publish_errors = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.525457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.525585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.525726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.525726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.525990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.526124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.526253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.526379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.526511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.526647 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.526817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.526817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] standard_threads = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.527104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.527232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.527232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.527558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.527703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.527703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] use_journal = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.528082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.528284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] use_json = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.528488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.528701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] use_stderr = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.528901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.529108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] use_syslog = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.529345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.529537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 18:43:02.529677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.529677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.529942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.530831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.530971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.531100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.531228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.531472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.531613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.531743 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.531869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.531995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.532134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.532270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.532440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.532581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.532710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.532837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.532972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.533109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.533109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.533352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.533481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.533614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.533741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.533889 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.534018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.534146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.534273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.534400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.534528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.534665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.534800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.534938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.535067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.535194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.535374 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.535525 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.535657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.537061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.537292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.537497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.537667 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.537932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.538643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.538811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.539004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.539196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.539446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.539612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.539877 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.540081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.540286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.540480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.540708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.540919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.541086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.541279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.541603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.541769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.542001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.542166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.542358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.542549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.542713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.542874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.543056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.543202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.543366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.543542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.543675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.543803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.543931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.544061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.544229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.544364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.544492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.544620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.544747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.544890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.545040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.545177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.545313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.545442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.545605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.545748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.545884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.546012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.546141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.546269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.546397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.546533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.546663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.546801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.546929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.547057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.547230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.547405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.547538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.547666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.547794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] auth.external = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.547921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.548056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.548228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.548411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.548543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.548681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.548810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.548945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] auth.password = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.549149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.549282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] auth.token = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.549410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.549538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.549666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.549793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.549928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.550058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.550192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.550323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.550451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.550589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.550727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.550865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.550994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.551195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.551356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.551492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] credential.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.551632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.551776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.551914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.552044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.552173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.552301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.552440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.552569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.552706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.552836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.552964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.553093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.553227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.553356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.553497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.553633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.553763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.553891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.554019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.554155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.554294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.554423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.554552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.554680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.554808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.554955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.555086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.555215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.555488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.555488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.555772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.555772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] federation.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.556028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.556183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.556340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.556478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.556610 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.556738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.556866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.557003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.557150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.557285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.557423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.557554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.557690 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.557845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.558050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.558257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.558460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.558667 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.558872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.559082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.559349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.559562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.559704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.559836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.559966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.560725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.560867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.560998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.561129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.561270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.561410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.561553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.561685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.561816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.561946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.562075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.562205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.562344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.562476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.562606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.562736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.562867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.563007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.563150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.563281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.563447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.563447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.563694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.563823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.563823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.564083 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.564214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.564214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.564459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.564841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.564841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.565111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] auth.external = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.565242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.565378 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.565518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.565518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.565518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.565972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.566104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.566233 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.566363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.566493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] auth.password = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.566493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] auth.token = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.566749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.566897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.566897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.567146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.567275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.567442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.567575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.567575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.567820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.567820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.568073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.568213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.568344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.568474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.568474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.568729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] credential.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.568865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.569004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.569617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.569750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.569879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570536 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.570931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.571204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.571392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.571529 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.571660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.571801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.571932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.572067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.572197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.572327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.572456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.572593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.572724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.572863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.572993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.573123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.573257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.573257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.573513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.573642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.573777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] federation.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.573908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.574038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.574175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.574305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.574441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.574572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.574712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.574841 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.574981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.575112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.575241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.575396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.575538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.575668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.575809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.575940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.576070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.576199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.576336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.576479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.576618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.576749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.576879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.577017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.577154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.577285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.577422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.577555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.577685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.577814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.577944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.578211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.578352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.578482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.578613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.578742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.578870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.579010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.579141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.579271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.579271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.579570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.579701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.579842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.579973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.580113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.580244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.580373 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.580502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.580639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.580771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.580902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.581031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.581161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.581290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.581428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.581559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.581688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.581819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.581959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.582089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.582227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.582358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.582488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.582617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.582747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.582876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.583015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.583146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.583275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.583436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.583569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.583698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] resource.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.583846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.583978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.584108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.584237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.584367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.584509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.584641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.584897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.585033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.585163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.585293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.585431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.585578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.585723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.585853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.585985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.586114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.586252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.586382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.586512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] role.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.586642 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.586771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] role.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.586900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.587038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.587170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.587315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.587461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.587601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.587733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.587874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.588006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.588136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.588265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.588394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.588524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.588661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.588792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.588922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.589052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.589181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.589310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.589456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.589588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.589718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.589847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.589977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.590108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.590246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.590377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.590506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.590636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.590636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.590881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.591020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.591180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.591341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.591480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.591611 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.591740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.591990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.592191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.592392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.592591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.592792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.592996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.593217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.593438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.593635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.593778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.593911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.594041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.594773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.594908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.595038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.595169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.595320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.595470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.595604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.595734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.595863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.595991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.596142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.596282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.596414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.596550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.596681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.596816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.596946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.597083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.597213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.597348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] token.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.597480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.597609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.597739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.597886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.598017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.598146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.598284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.598415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.598550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.598689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.598820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.598948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.599077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.599206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.599384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.599524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.599671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.599822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.599947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.600080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.600210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.600853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.601026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.601159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.601288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.601418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.601547 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.601686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.601817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.601947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.602076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.602216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.602216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.602471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.602602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.connection = **** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.602741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] resource.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.602880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.602880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.603127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.603256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.603256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.603555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.603688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.603688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.603934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.604074 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.604074 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.604328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.604459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.604459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.604702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.604702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.604948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.605086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.605218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.605347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.605347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.605592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.605740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] role.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.605740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] role.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.605987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.606126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.606256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.606386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.606523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.606523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.606770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.606901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.606901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.607146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.608309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.609379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] token.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.610451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.611550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.connection = **** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.612629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.613708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.614924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.614924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.614924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.614924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 18:43:02.614924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 18:43:02.624850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.625093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.625297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.634316 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.637251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.637488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.637716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.646644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.668970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.669262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.670622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.670903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.724711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.725159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.776848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.777149 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.777353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.777591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.844531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.844696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.844770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.844853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.845077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.845165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.845229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.845290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.845453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.845544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.845608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.845669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.868715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.868945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.869942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.870005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.870076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.870290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.881284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.882327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.896377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.896641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.896791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.896875 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.897042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.897123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.897329 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.897451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.898121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.898204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.898268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.898328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.898572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.898652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 18:43:02.915581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.915799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 18:43:02.915890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.916098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 18:43:02.916185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.916364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 18:43:02.916447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.916616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 18:43:02.916697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.916875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.916957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.917120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.917201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.917364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.917455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.917625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.928357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.929147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.929299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.929451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.929604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.929744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.929884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.930025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.937770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.938096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.941379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.941665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.941836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.941978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.942129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.942270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.942411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.942576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.942724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.942863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.943011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.943151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.943335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.943484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.943623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.943774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.943914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.944052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.944718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.944867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.945016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.945156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.971987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.972210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.973619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.973871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.974041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.974187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.979814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.980198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.980349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.980491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.980630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.987765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.988046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.988674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.988966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.992757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.993051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.993331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.993611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.993771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:02.993915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.994073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.994212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.994351 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.994500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.994641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.994779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.994920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.995059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.995233 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:02.995523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.013323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.013601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.014430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.014703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.018092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.019271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.021730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.022023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.023404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.023695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.027523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.028660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.031434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.032232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.035286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.035603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.035886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.035976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.036168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.036340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.036517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.036603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.036788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.036872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.037050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.037285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.056307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.056689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.056778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.056971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.057121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.057202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.057382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.057608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.065399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.065781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.067128 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.067427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.067514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.067773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.070497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.070776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.070871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.071060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.071147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.071355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.071457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.071628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.071711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.071930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.085550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.085735 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.085837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.086023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.086108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.086284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.086367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.086565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.086653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.086832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.086926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.087107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.087190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.087405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.105676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.105966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.108994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.109251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.112432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.112589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.114023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.114219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.115687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.115869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.116093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.116175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.116253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.116463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.123676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.123870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.125296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.125457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.128622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.128776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.128946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.129107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.129260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.129410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.129550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.129689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.138733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.138908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.139068 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.139209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.139379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.139537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.147151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.147871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 18:43:03.148015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.148150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.148328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.148542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.148685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.148888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.149032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.149166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.149466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.149619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.149938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.150098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.150366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.150528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.150724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.150867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.151007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.151148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.151289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.151514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.151657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.152603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.155652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.155839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.155839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.155839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 18:43:03.193672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b430d3d9c0 pid: 79852 (default app) May 11 18:43:03.193907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b430d3d9c0 pid: 79853 (default app) May 11 18:43:03.199836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea4727-df42-4675-913a-ff44a4dca539 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:03.199836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea4727-df42-4675-913a-ff44a4dca539 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:03.199836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea4727-df42-4675-913a-ff44a4dca539 None None] PATH_INFO: `/v3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:03.205095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 791 bytes} [Wed May 11 18:43:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:11.196579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5571ab-31df-467d-b132-0252c793ea45 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:11.200493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5571ab-31df-467d-b132-0252c793ea45 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:11.204546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5571ab-31df-467d-b132-0252c793ea45 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:11.208523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1/2] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:11 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:11.214416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:11.214876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:11.215061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:11.248816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG oslo_db.sqlalchemy.engines [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:43:11.437230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG passlib.handlers.bcrypt [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79852) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 18:43:11.437647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG passlib.handlers.bcrypt [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79852) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 18:43:11.494000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:11.495862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:11.618546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 2/3] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 18:43:11.783967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5571ab-31df-467d-b132-0252c793ea45 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:11.817234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5571ab-31df-467d-b132-0252c793ea45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 18:43:11.945122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5571ab-31df-467d-b132-0252c793ea45 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:11.949364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba899-61b9-4621-91b2-aa23878a2d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:11.950025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba899-61b9-4621-91b2-aa23878a2d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:11.950308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba899-61b9-4621-91b2-aa23878a2d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:11.950584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba899-61b9-4621-91b2-aa23878a2d77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:11.958707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dba899-61b9-4621-91b2-aa23878a2d77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:12.010922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e3dba899-61b9-4621-91b2-aa23878a2d77 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 18:43:12.011262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dba899-61b9-4621-91b2-aa23878a2d77 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:12.021136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 2/4] 10.222.0.93 () {58 vars in 1324 bytes} [Wed May 11 18:43:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 18:43:12.027569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:12.042079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5a727-8046-41c2-96b1-e8617748f67c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:12.046449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca810d-6bcf-499b-b288-dfe62073daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:12.047671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca810d-6bcf-499b-b288-dfe62073daee admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:12.048020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca810d-6bcf-499b-b288-dfe62073daee admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:12.048356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca810d-6bcf-499b-b288-dfe62073daee admin admin] PATH_INFO: `/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:12.049927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca810d-6bcf-499b-b288-dfe62073daee admin admin] RBAC: Authorizing `identity:get_project(project_id=639dcabe7cb941cc82eb0b4e6f620fd4)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:12.100901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6bca810d-6bcf-499b-b288-dfe62073daee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 18:43:12.101246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca810d-6bcf-499b-b288-dfe62073daee admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:12.105833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 3/5] 10.222.0.93 () {56 vars in 1207 bytes} [Wed May 11 18:43:12 2022] GET /identity/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:14.300383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8071801-c624-4007-89fe-9fa64365eea3 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:14.300914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8071801-c624-4007-89fe-9fa64365eea3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:14.300914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8071801-c624-4007-89fe-9fa64365eea3 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:14.305617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 3/6] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:14.310943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a238-4908-4698-81e5-f1dcd00f8034 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:14.311373 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a238-4908-4698-81e5-f1dcd00f8034 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:14.311595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2a238-4908-4698-81e5-f1dcd00f8034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:14.331914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-baf2a238-4908-4698-81e5-f1dcd00f8034 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:14.333422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-baf2a238-4908-4698-81e5-f1dcd00f8034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:14.341385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 4/7] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 11 18:43:14.362772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8071801-c624-4007-89fe-9fa64365eea3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:14.374867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8071801-c624-4007-89fe-9fa64365eea3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:14.378982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1156dd7-e4db-40a6-8e45-f061acd9853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:14.379636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156dd7-e4db-40a6-8e45-f061acd9853c admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:14.379914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156dd7-e4db-40a6-8e45-f061acd9853c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:14.380184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156dd7-e4db-40a6-8e45-f061acd9853c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:14.388183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1156dd7-e4db-40a6-8e45-f061acd9853c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:14.389924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1156dd7-e4db-40a6-8e45-f061acd9853c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:14.398726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 4/8] 10.222.0.93 () {58 vars in 1324 bytes} [Wed May 11 18:43:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 18:43:14.404097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2a238-4908-4698-81e5-f1dcd00f8034 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:14.413335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2a238-4908-4698-81e5-f1dcd00f8034 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:14.417753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5349b15-c403-4190-8f58-216ef1722afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:14.418606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5349b15-c403-4190-8f58-216ef1722afe admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:14.418885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5349b15-c403-4190-8f58-216ef1722afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:14.419158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5349b15-c403-4190-8f58-216ef1722afe admin admin] PATH_INFO: `/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:14.420577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5349b15-c403-4190-8f58-216ef1722afe admin admin] RBAC: Authorizing `identity:get_user(user_id=2e7cd529baa6412fbb8c3f6158f7ed52)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:14.422403 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5349b15-c403-4190-8f58-216ef1722afe admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:14.423995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 5/9] 10.222.0.93 () {56 vars in 1198 bytes} [Wed May 11 18:43:14 2022] GET /identity/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:16.693145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4cc21-c945-4d8e-8ddc-2758d83dd466 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:16.693678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4cc21-c945-4d8e-8ddc-2758d83dd466 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:16.693678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4cc21-c945-4d8e-8ddc-2758d83dd466 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:16.695018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 5/10] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:16.700696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76bac-a591-4d4a-b40f-a4a4478d5887 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:16.701114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76bac-a591-4d4a-b40f-a4a4478d5887 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:16.701321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76bac-a591-4d4a-b40f-a4a4478d5887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:16.734628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab2f4-fa07-4af0-8309-3cefa8672f83 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:16.734908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab2f4-fa07-4af0-8309-3cefa8672f83 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:16.735181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab2f4-fa07-4af0-8309-3cefa8672f83 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:16.736581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 6/11] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:16.743098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:16.743484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:16.743835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:16.785437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG passlib.handlers.bcrypt [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79853) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 18:43:16.785850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG passlib.handlers.bcrypt [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79853) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 18:43:16.832325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f8b76bac-a591-4d4a-b40f-a4a4478d5887 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:16.833406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:16.833534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f8b76bac-a591-4d4a-b40f-a4a4478d5887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:16.834984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:16.910021 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 6/12] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:16.933442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 7/13] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:16.934025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b76bac-a591-4d4a-b40f-a4a4478d5887 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:16.956368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:17.029570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b76bac-a591-4d4a-b40f-a4a4478d5887 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:17.053302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fb67a-1680-449a-bb09-9639567b5ebb None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:17.061989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493620d0-d8af-43fb-a1ee-f9d6b17df376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:17.062775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493620d0-d8af-43fb-a1ee-f9d6b17df376 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:17.063055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493620d0-d8af-43fb-a1ee-f9d6b17df376 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:17.063350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493620d0-d8af-43fb-a1ee-f9d6b17df376 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:17.074252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493620d0-d8af-43fb-a1ee-f9d6b17df376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-493620d0-d8af-43fb-a1ee-f9d6b17df376 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:17.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:17.086341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:17.087136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:17.087766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca163-5c27-45d4-bee5-b88a5b911b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:17.087766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca163-5c27-45d4-bee5-b88a5b911b7e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:17.087766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca163-5c27-45d4-bee5-b88a5b911b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:17.087766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca163-5c27-45d4-bee5-b88a5b911b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:17.091282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 7/14] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:43:17.092231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493620d0-d8af-43fb-a1ee-f9d6b17df376 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:17.150380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ca163-5c27-45d4-bee5-b88a5b911b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:17.151922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ca163-5c27-45d4-bee5-b88a5b911b7e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:17.185149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493620d0-d8af-43fb-a1ee-f9d6b17df376 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:17.218191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:17.218800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:17.219081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:17.219381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:17.220130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:17.220434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:17.221840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:17.233805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 8/15] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:17.239195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:17.244299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 8/16] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 18:43:17.249566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca163-5c27-45d4-bee5-b88a5b911b7e None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:17.346000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2489-be02-4aac-9580-ff05ef346904 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:17.349561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca163-5c27-45d4-bee5-b88a5b911b7e None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:17.377858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbc3a4-9c26-4ae6-95e9-e18fb7d6d2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:17.378727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbc3a4-9c26-4ae6-95e9-e18fb7d6d2a4 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:17.379009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbc3a4-9c26-4ae6-95e9-e18fb7d6d2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:17.379280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbc3a4-9c26-4ae6-95e9-e18fb7d6d2a4 None admin] PATH_INFO: `/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:17.380489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbc3a4-9c26-4ae6-95e9-e18fb7d6d2a4 None admin] RBAC: Authorizing `identity:get_user(user_id=2e7cd529baa6412fbb8c3f6158f7ed52)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:17.381235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:17.382530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbc3a4-9c26-4ae6-95e9-e18fb7d6d2a4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:17.382624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:17.382836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:17.383102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:17.384183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 9/17] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:17 2022] GET /identity/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:17.389618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbc3a4-9c26-4ae6-95e9-e18fb7d6d2a4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:17.490128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbc3a4-9c26-4ae6-95e9-e18fb7d6d2a4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:17.509190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:17.510652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:17.523109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995127-3617-4a29-8539-b092a1b97f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:17.523934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995127-3617-4a29-8539-b092a1b97f46 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:17.524217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995127-3617-4a29-8539-b092a1b97f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:17.524491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995127-3617-4a29-8539-b092a1b97f46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:17.525665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8995127-3617-4a29-8539-b092a1b97f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:17.527093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8995127-3617-4a29-8539-b092a1b97f46 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:17.528730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 10/18] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:43:17.531668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:17.532541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:17.533308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:43:17.533308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:43:17.533308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:43:17.533308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:17.533308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 9/19] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:43:17.534480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995127-3617-4a29-8539-b092a1b97f46 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:17.538901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:17.628026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995127-3617-4a29-8539-b092a1b97f46 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:17.633362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360b921-60ea-4489-926f-fb68d497ae9a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:17.660087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069155d2-00f6-4cda-a15f-41a46340d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:17.660733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069155d2-00f6-4cda-a15f-41a46340d889 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:17.661013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069155d2-00f6-4cda-a15f-41a46340d889 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:17.661288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069155d2-00f6-4cda-a15f-41a46340d889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:17.662126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069155d2-00f6-4cda-a15f-41a46340d889 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.domain.id=default, user.id=2e7cd529baa6412fbb8c3f6158f7ed52) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:17.662437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069155d2-00f6-4cda-a15f-41a46340d889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:17.663945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069155d2-00f6-4cda-a15f-41a46340d889 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:17.665310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd16e82-18d5-4e20-87eb-9998e45a684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:17.665957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd16e82-18d5-4e20-87eb-9998e45a684a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:17.666234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd16e82-18d5-4e20-87eb-9998e45a684a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:17.666504 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd16e82-18d5-4e20-87eb-9998e45a684a None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:17.667218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd16e82-18d5-4e20-87eb-9998e45a684a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:17.667546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd16e82-18d5-4e20-87eb-9998e45a684a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:17.668895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd16e82-18d5-4e20-87eb-9998e45a684a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:17.670618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 11/20] 10.222.0.93 () {56 vars in 1322 bytes} [Wed May 11 18:43:17 2022] GET /identity/v3/role_assignments?user.id=2e7cd529baa6412fbb8c3f6158f7ed52&scope.domain.id=default&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:17.699333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 10/21] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:20.149935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ac231-cd0a-48b3-978e-2fe04981db47 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.150466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ac231-cd0a-48b3-978e-2fe04981db47 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.150466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ac231-cd0a-48b3-978e-2fe04981db47 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.152040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 12/22] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:20.162044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee722-f4d9-45c6-934c-53d9a13562fa None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.163012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee722-f4d9-45c6-934c-53d9a13562fa None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.163192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee722-f4d9-45c6-934c-53d9a13562fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.188310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-70eee722-f4d9-45c6-934c-53d9a13562fa None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:20.189535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-70eee722-f4d9-45c6-934c-53d9a13562fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:20.277896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 11/23] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:20.316631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ac231-cd0a-48b3-978e-2fe04981db47 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:20.445406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ac231-cd0a-48b3-978e-2fe04981db47 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:20.491932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2394af-5222-4108-acfd-07ac0250fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:20.492741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2394af-5222-4108-acfd-07ac0250fb33 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.493026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2394af-5222-4108-acfd-07ac0250fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.493303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2394af-5222-4108-acfd-07ac0250fb33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.508300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2394af-5222-4108-acfd-07ac0250fb33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-4b2394af-5222-4108-acfd-07ac0250fb33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:20.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:20.516822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:20.517984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 13/24] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:20.523661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee722-f4d9-45c6-934c-53d9a13562fa None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:20.636888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee722-f4d9-45c6-934c-53d9a13562fa None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:20.659684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa4bb-4752-46d3-9a81-b54ef57d94fc None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.660022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa4bb-4752-46d3-9a81-b54ef57d94fc None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.660217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaa4bb-4752-46d3-9a81-b54ef57d94fc None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.661996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 14/25] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:20.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ab2d-1433-490c-98b3-6d6e4a3a6848 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.664824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ab2d-1433-490c-98b3-6d6e4a3a6848 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.665569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ab2d-1433-490c-98b3-6d6e4a3a6848 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.671445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 15/26] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:20.673143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4a3f-e7e7-4740-a448-dc962b7e699d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.673739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4a3f-e7e7-4740-a448-dc962b7e699d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.674525 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4a3f-e7e7-4740-a448-dc962b7e699d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.691997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafd9a8-bbe3-4274-8b0b-98970d1206e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:20.692943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd9a8-bbe3-4274-8b0b-98970d1206e7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.693403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd9a8-bbe3-4274-8b0b-98970d1206e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.693901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd9a8-bbe3-4274-8b0b-98970d1206e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.694699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-230a4a3f-e7e7-4740-a448-dc962b7e699d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:20.694893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd9a8-bbe3-4274-8b0b-98970d1206e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:20.695167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd9a8-bbe3-4274-8b0b-98970d1206e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:20.696553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-230a4a3f-e7e7-4740-a448-dc962b7e699d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:20.696656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd9a8-bbe3-4274-8b0b-98970d1206e7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:20.713330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 12/27] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:20.714606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329fc6d-637e-4c96-b592-9f33a3e4e824 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.714897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329fc6d-637e-4c96-b592-9f33a3e4e824 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.715174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329fc6d-637e-4c96-b592-9f33a3e4e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.742921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4329fc6d-637e-4c96-b592-9f33a3e4e824 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:20.744513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4329fc6d-637e-4c96-b592-9f33a3e4e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:20.779507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 16/28] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:20.780871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a4a3f-e7e7-4740-a448-dc962b7e699d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:20.905348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 13/29] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:20.906443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329fc6d-637e-4c96-b592-9f33a3e4e824 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:20.911063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a4a3f-e7e7-4740-a448-dc962b7e699d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:20.951333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86eadb-f78f-498d-ac00-f826c4b894fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:20.952965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86eadb-f78f-498d-ac00-f826c4b894fd None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:20.953451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86eadb-f78f-498d-ac00-f826c4b894fd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:20.954081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86eadb-f78f-498d-ac00-f826c4b894fd None admin] PATH_INFO: `/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:20.955550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86eadb-f78f-498d-ac00-f826c4b894fd None admin] RBAC: Authorizing `identity:get_user(user_id=2e7cd529baa6412fbb8c3f6158f7ed52)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:20.957229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86eadb-f78f-498d-ac00-f826c4b894fd None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:20.959121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 17/30] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:20 2022] GET /identity/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:20.961091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86eadb-f78f-498d-ac00-f826c4b894fd None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:21.081828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86eadb-f78f-498d-ac00-f826c4b894fd None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:21.122129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d9516-2ecc-4040-89d4-f77cfa95f0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:21.123238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d9516-2ecc-4040-89d4-f77cfa95f0b4 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.123766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d9516-2ecc-4040-89d4-f77cfa95f0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.124238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d9516-2ecc-4040-89d4-f77cfa95f0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.125954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d9516-2ecc-4040-89d4-f77cfa95f0b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:21.127658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d9516-2ecc-4040-89d4-f77cfa95f0b4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:21.139039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329fc6d-637e-4c96-b592-9f33a3e4e824 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:21.214955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:21.216462 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.216971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.217433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.228037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:21.229750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:43:21.248104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:21.248934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:21.249705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:43:21.249705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:43:21.249705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:43:21.249705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:21.251618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 14/31] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:21.252671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:21.290980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 18/32] 10.222.0.93 () {60 vars in 1131 bytes} [Wed May 11 18:43:20 2022] POST /identity/v3/roles => generated 219 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:21.292012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d9516-2ecc-4040-89d4-f77cfa95f0b4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:21.367533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844eb24-f8b4-4778-8574-a61b4b475889 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:21.400931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d9516-2ecc-4040-89d4-f77cfa95f0b4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:21.402895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2708327-e6ed-4897-9b9c-f60d4472e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:21.404005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2708327-e6ed-4897-9b9c-f60d4472e3aa None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.404561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2708327-e6ed-4897-9b9c-f60d4472e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.405032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2708327-e6ed-4897-9b9c-f60d4472e3aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.406843 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2708327-e6ed-4897-9b9c-f60d4472e3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:21.408590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2708327-e6ed-4897-9b9c-f60d4472e3aa None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:21.410532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 15/33] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:21.412165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746d76f-c188-4de7-bce0-11754f1d8cf6 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.413188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746d76f-c188-4de7-bce0-11754f1d8cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.413655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746d76f-c188-4de7-bce0-11754f1d8cf6 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.415394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 16/34] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:21.418509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746d76f-c188-4de7-bce0-11754f1d8cf6 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:21.461798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1da15b-ea68-4aa5-9469-2f03c5364b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:21.462419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da15b-ea68-4aa5-9469-2f03c5364b7a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.462709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da15b-ea68-4aa5-9469-2f03c5364b7a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.462993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da15b-ea68-4aa5-9469-2f03c5364b7a None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.463879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1da15b-ea68-4aa5-9469-2f03c5364b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:21.464196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1da15b-ea68-4aa5-9469-2f03c5364b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:21.465862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1da15b-ea68-4aa5-9469-2f03c5364b7a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:21.494601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 19/35] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:21.500385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101241-4adb-4014-b4cd-7f1c2cb8d3e9 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.500712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101241-4adb-4014-b4cd-7f1c2cb8d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.500965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101241-4adb-4014-b4cd-7f1c2cb8d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.521560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-ff101241-4adb-4014-b4cd-7f1c2cb8d3e9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:21.523372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ff101241-4adb-4014-b4cd-7f1c2cb8d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:21.606406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 20/36] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:21.607045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101241-4adb-4014-b4cd-7f1c2cb8d3e9 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:21.607657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746d76f-c188-4de7-bce0-11754f1d8cf6 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:21.645627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852cab0-c883-4cc3-ad78-4cf401ad7c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:21.647678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852cab0-c883-4cc3-ad78-4cf401ad7c9c None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.647974 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852cab0-c883-4cc3-ad78-4cf401ad7c9c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.648264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852cab0-c883-4cc3-ad78-4cf401ad7c9c None admin] PATH_INFO: `/v3/domains/default/users/2e7cd529baa6412fbb8c3f6158f7ed52/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.650745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852cab0-c883-4cc3-ad78-4cf401ad7c9c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2e7cd529baa6412fbb8c3f6158f7ed52, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:21.652306 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852cab0-c883-4cc3-ad78-4cf401ad7c9c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:21.731485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101241-4adb-4014-b4cd-7f1c2cb8d3e9 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:21.764842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9e61-7e39-4398-9197-fc6cf4dd79e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:21.765509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9e61-7e39-4398-9197-fc6cf4dd79e7 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.765799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9e61-7e39-4398-9197-fc6cf4dd79e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.766078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9e61-7e39-4398-9197-fc6cf4dd79e7 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.766780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af9e61-7e39-4398-9197-fc6cf4dd79e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:21.768282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af9e61-7e39-4398-9197-fc6cf4dd79e7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:21.785212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 17/37] 10.222.0.93 () {58 vars in 1361 bytes} [Wed May 11 18:43:21 2022] PUT /identity/v3/domains/default/users/2e7cd529baa6412fbb8c3f6158f7ed52/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:21.786595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852cab0-c883-4cc3-ad78-4cf401ad7c9c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:21.807848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 21/38] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:43:21 2022] POST /identity/v3/projects => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:21.809615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6f23-d600-4de3-8348-81ada6d9b0e4 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.810097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6f23-d600-4de3-8348-81ada6d9b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.810640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e6f23-d600-4de3-8348-81ada6d9b0e4 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.812302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 22/39] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:21.820119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614081b-313b-4eab-829a-f11ba886955d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.820417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614081b-313b-4eab-829a-f11ba886955d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.820673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614081b-313b-4eab-829a-f11ba886955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.842952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7614081b-313b-4eab-829a-f11ba886955d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:21.844963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7614081b-313b-4eab-829a-f11ba886955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:21.929574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852cab0-c883-4cc3-ad78-4cf401ad7c9c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:21.936582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 23/40] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:21.961668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614081b-313b-4eab-829a-f11ba886955d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:21.972496 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d233f7-e54d-4714-aa33-286bd8b4a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:21.973907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d233f7-e54d-4714-aa33-286bd8b4a2d0 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:21.974549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d233f7-e54d-4714-aa33-286bd8b4a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:21.975136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d233f7-e54d-4714-aa33-286bd8b4a2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:21.976144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d233f7-e54d-4714-aa33-286bd8b4a2d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:21.978925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d233f7-e54d-4714-aa33-286bd8b4a2d0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:22.006146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 18/41] 10.222.0.93 () {60 vars in 1131 bytes} [Wed May 11 18:43:21 2022] POST /identity/v3/roles => generated 225 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:22.085733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614081b-313b-4eab-829a-f11ba886955d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:22.126354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b892a-1683-4865-9499-11e57f609718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:22.127192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b892a-1683-4865-9499-11e57f609718 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:22.127514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b892a-1683-4865-9499-11e57f609718 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:22.127793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b892a-1683-4865-9499-11e57f609718 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:22.129126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b892a-1683-4865-9499-11e57f609718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:22.130712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b892a-1683-4865-9499-11e57f609718 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:22.133306 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 24/42] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:22.139944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d233f7-e54d-4714-aa33-286bd8b4a2d0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:22.175386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ceea4-825a-46fd-9eea-e01e2b455a54 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:22.175724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ceea4-825a-46fd-9eea-e01e2b455a54 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:22.175953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ceea4-825a-46fd-9eea-e01e2b455a54 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:22.177516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 25/43] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:22.188881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b2019-6b0e-4b2d-aced-46032832796e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:22.189222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b2019-6b0e-4b2d-aced-46032832796e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:22.189448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b2019-6b0e-4b2d-aced-46032832796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:22.215262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a98b2019-6b0e-4b2d-aced-46032832796e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:22.216657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a98b2019-6b0e-4b2d-aced-46032832796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:22.261241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d233f7-e54d-4714-aa33-286bd8b4a2d0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:22.289665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 26/44] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:22.298009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9730a-12f7-47a4-a380-0478d15f4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:22.298738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9730a-12f7-47a4-a380-0478d15f4ee7 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:22.299029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9730a-12f7-47a4-a380-0478d15f4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:22.299335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9730a-12f7-47a4-a380-0478d15f4ee7 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:22.300110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9730a-12f7-47a4-a380-0478d15f4ee7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:22.301612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9730a-12f7-47a4-a380-0478d15f4ee7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:22.313535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b2019-6b0e-4b2d-aced-46032832796e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:22.335562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 19/45] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:43:22 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:22.424834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b2019-6b0e-4b2d-aced-46032832796e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:22.460561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ba99a-ac96-47d9-94e7-5f699ba07ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:22.461638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ba99a-ac96-47d9-94e7-5f699ba07ee6 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:22.462121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ba99a-ac96-47d9-94e7-5f699ba07ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:22.462589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ba99a-ac96-47d9-94e7-5f699ba07ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:22.463645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ba99a-ac96-47d9-94e7-5f699ba07ee6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:22.465288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ba99a-ac96-47d9-94e7-5f699ba07ee6 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:22.480189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 27/46] 10.222.0.93 () {60 vars in 1131 bytes} [Wed May 11 18:43:22 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:43:24.221720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897c00b-2629-41d7-b3fb-bc08e1ad67f1 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.222164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897c00b-2629-41d7-b3fb-bc08e1ad67f1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.222283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897c00b-2629-41d7-b3fb-bc08e1ad67f1 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.223686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 20/47] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:24.229519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f50e-dcda-4e9f-a308-c1a733e315e7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.229925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f50e-dcda-4e9f-a308-c1a733e315e7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.230076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f50e-dcda-4e9f-a308-c1a733e315e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.247029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-02f6f50e-dcda-4e9f-a308-c1a733e315e7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:24.248244 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-02f6f50e-dcda-4e9f-a308-c1a733e315e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:24.309259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 28/48] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:24.332519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897c00b-2629-41d7-b3fb-bc08e1ad67f1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:24.442465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897c00b-2629-41d7-b3fb-bc08e1ad67f1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:24.475458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0638f-e6dd-4f2f-b870-b491669aba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:24.476173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0638f-e6dd-4f2f-b870-b491669aba7e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.476454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0638f-e6dd-4f2f-b870-b491669aba7e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.476727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0638f-e6dd-4f2f-b870-b491669aba7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.487397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0638f-e6dd-4f2f-b870-b491669aba7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-4dc0638f-e6dd-4f2f-b870-b491669aba7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:24.496159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:24.497038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:24.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 21/49] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:24.503221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6f50e-dcda-4e9f-a308-c1a733e315e7 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:24.592030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742bff-9305-4dc4-a578-f2e875ea8d0c None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.592309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742bff-9305-4dc4-a578-f2e875ea8d0c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.592585 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742bff-9305-4dc4-a578-f2e875ea8d0c None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.593951 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 22/50] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:24.596413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6f50e-dcda-4e9f-a308-c1a733e315e7 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:24.598644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7bbfe-d246-4159-8476-1daa0ae57feb None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.598921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7bbfe-d246-4159-8476-1daa0ae57feb None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.599199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7bbfe-d246-4159-8476-1daa0ae57feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.616706 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-36b7bbfe-d246-4159-8476-1daa0ae57feb None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:24.618223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-36b7bbfe-d246-4159-8476-1daa0ae57feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:24.628943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:24.629609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.629891 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.630166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.630908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:24.631216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:24.632631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:24.640420 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 29/51] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:24.645895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:24.682247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 23/52] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:24.704498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7bbfe-d246-4159-8476-1daa0ae57feb None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:24.739836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab4a1-7cfe-4ba3-acae-db2e8cefe212 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:24.771806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c6518-c9d6-47ec-8790-1e6a492ed3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:24.772680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c6518-c9d6-47ec-8790-1e6a492ed3da None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.772969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c6518-c9d6-47ec-8790-1e6a492ed3da None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.773249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c6518-c9d6-47ec-8790-1e6a492ed3da None admin] PATH_INFO: `/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.774461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c6518-c9d6-47ec-8790-1e6a492ed3da None admin] RBAC: Authorizing `identity:get_user(user_id=2e7cd529baa6412fbb8c3f6158f7ed52)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:24.775993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c6518-c9d6-47ec-8790-1e6a492ed3da None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:24.777623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 30/53] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:24 2022] GET /identity/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:24.782846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c6518-c9d6-47ec-8790-1e6a492ed3da None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:24.797224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7bbfe-d246-4159-8476-1daa0ae57feb None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:24.836995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d848d18-f235-4349-8603-16454f5ffd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:24.838006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848d18-f235-4349-8603-16454f5ffd12 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.838275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848d18-f235-4349-8603-16454f5ffd12 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.838544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848d18-f235-4349-8603-16454f5ffd12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.839756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d848d18-f235-4349-8603-16454f5ffd12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:24.841436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d848d18-f235-4349-8603-16454f5ffd12 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:24.843326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 24/54] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:24.848744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d848d18-f235-4349-8603-16454f5ffd12 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:24.877632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c6518-c9d6-47ec-8790-1e6a492ed3da None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:24.909621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b38bb5-9ca5-4a2d-b2c5-05929c358012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:24.910404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38bb5-9ca5-4a2d-b2c5-05929c358012 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.910689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38bb5-9ca5-4a2d-b2c5-05929c358012 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.910965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38bb5-9ca5-4a2d-b2c5-05929c358012 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.912162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b38bb5-9ca5-4a2d-b2c5-05929c358012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:24.914162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b38bb5-9ca5-4a2d-b2c5-05929c358012 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:24.916006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 31/55] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:24.921546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b38bb5-9ca5-4a2d-b2c5-05929c358012 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:24.944617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d848d18-f235-4349-8603-16454f5ffd12 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:24.977027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21962b-4a0d-49d3-9cb6-a8b8b5b0de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:24.977683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21962b-4a0d-49d3-9cb6-a8b8b5b0de2f None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:24.977967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21962b-4a0d-49d3-9cb6-a8b8b5b0de2f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:24.978248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21962b-4a0d-49d3-9cb6-a8b8b5b0de2f None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:24.978959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21962b-4a0d-49d3-9cb6-a8b8b5b0de2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:24.980425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21962b-4a0d-49d3-9cb6-a8b8b5b0de2f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:25.004300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 25/56] 10.222.0.93 () {60 vars in 1140 bytes} [Wed May 11 18:43:24 2022] POST /identity/v3/projects => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:43:25.018070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b38bb5-9ca5-4a2d-b2c5-05929c358012 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:25.054673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fe04e-e31b-4ebd-9428-8704a8d250c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:25.055372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe04e-e31b-4ebd-9428-8704a8d250c9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:25.055659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe04e-e31b-4ebd-9428-8704a8d250c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:25.055937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe04e-e31b-4ebd-9428-8704a8d250c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:25.056785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe04e-e31b-4ebd-9428-8704a8d250c9 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.domain.id=default, user.id=2e7cd529baa6412fbb8c3f6158f7ed52) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:25.057097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe04e-e31b-4ebd-9428-8704a8d250c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:25.058607 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe04e-e31b-4ebd-9428-8704a8d250c9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:25.065491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 32/57] 10.222.0.93 () {56 vars in 1322 bytes} [Wed May 11 18:43:24 2022] GET /identity/v3/role_assignments?user.id=2e7cd529baa6412fbb8c3f6158f7ed52&scope.domain.id=default&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:27.257421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ec43-9bda-4eca-9449-85c48da33470 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:27.257854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ec43-9bda-4eca-9449-85c48da33470 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:27.257986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ec43-9bda-4eca-9449-85c48da33470 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:27.259387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 26/58] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:27.264538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d632f0-e175-4e65-83ff-c53a0fa8f4b1 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:27.264893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d632f0-e175-4e65-83ff-c53a0fa8f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:27.265096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d632f0-e175-4e65-83ff-c53a0fa8f4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:27.281818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f5d632f0-e175-4e65-83ff-c53a0fa8f4b1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:27.283002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f5d632f0-e175-4e65-83ff-c53a0fa8f4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:27.346722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 33/59] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:27.371776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ec43-9bda-4eca-9449-85c48da33470 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:27.471619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ec43-9bda-4eca-9449-85c48da33470 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:27.502068 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651bf35-b955-4781-9e13-91e077de0baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:27.502851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651bf35-b955-4781-9e13-91e077de0baa None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:27.503138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651bf35-b955-4781-9e13-91e077de0baa None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:27.503444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651bf35-b955-4781-9e13-91e077de0baa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:27.504613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651bf35-b955-4781-9e13-91e077de0baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:27.506528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651bf35-b955-4781-9e13-91e077de0baa None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:27.508162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 27/60] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:27.513859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d632f0-e175-4e65-83ff-c53a0fa8f4b1 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:27.607862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d632f0-e175-4e65-83ff-c53a0fa8f4b1 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:27.639518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666da2f-3a3f-4c94-a065-06f06fe25190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:27.640199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666da2f-3a3f-4c94-a065-06f06fe25190 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:27.640477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666da2f-3a3f-4c94-a065-06f06fe25190 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:27.640747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666da2f-3a3f-4c94-a065-06f06fe25190 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:27.641450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666da2f-3a3f-4c94-a065-06f06fe25190 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:27.643195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666da2f-3a3f-4c94-a065-06f06fe25190 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:27.667158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 34/61] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:43:27 2022] POST /identity/v3/users => generated 275 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:31.120343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11fe1-55f0-453c-8abc-57fa945bc035 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.121427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11fe1-55f0-453c-8abc-57fa945bc035 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.121938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11fe1-55f0-453c-8abc-57fa945bc035 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.123659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 28/62] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:31.130020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a2e85-85ac-40b0-aae3-adbdcfdb08f2 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.131062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a2e85-85ac-40b0-aae3-adbdcfdb08f2 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.131577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a2e85-85ac-40b0-aae3-adbdcfdb08f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.156356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-ce5a2e85-85ac-40b0-aae3-adbdcfdb08f2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:31.157875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ce5a2e85-85ac-40b0-aae3-adbdcfdb08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:31.236373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6fb5f-1316-4e2a-99ba-9b5b1bfca578 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.236683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6fb5f-1316-4e2a-99ba-9b5b1bfca578 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.236920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6fb5f-1316-4e2a-99ba-9b5b1bfca578 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.238277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 29/63] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:31.244392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb96d3-9a0a-4949-b4ee-c98a2f6c85ad None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.244673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb96d3-9a0a-4949-b4ee-c98a2f6c85ad None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.244946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb96d3-9a0a-4949-b4ee-c98a2f6c85ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.268718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-bacb96d3-9a0a-4949-b4ee-c98a2f6c85ad None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:31.268718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bacb96d3-9a0a-4949-b4ee-c98a2f6c85ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:31.270651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 35/64] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:31.293805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a2e85-85ac-40b0-aae3-adbdcfdb08f2 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:31.365359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 30/65] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:31.367599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc947a48-8682-4fdb-bee8-adbdd158dddf None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.368114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc947a48-8682-4fdb-bee8-adbdd158dddf None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.368587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc947a48-8682-4fdb-bee8-adbdd158dddf None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.370409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 31/66] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:31.375664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027270c-4795-46a1-ae84-94ea880c3093 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.376159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027270c-4795-46a1-ae84-94ea880c3093 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.376650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027270c-4795-46a1-ae84-94ea880c3093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.393009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c027270c-4795-46a1-ae84-94ea880c3093 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:31.394495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c027270c-4795-46a1-ae84-94ea880c3093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:31.422292 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a2e85-85ac-40b0-aae3-adbdcfdb08f2 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:31.458326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d8941-c001-4dcd-8881-ebd5bbf003da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:31.462174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d8941-c001-4dcd-8881-ebd5bbf003da None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.463099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d8941-c001-4dcd-8881-ebd5bbf003da None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.465139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d8941-c001-4dcd-8881-ebd5bbf003da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.471349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 32/67] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:31.471349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027270c-4795-46a1-ae84-94ea880c3093 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:31.504426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d8941-c001-4dcd-8881-ebd5bbf003da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-c25d8941-c001-4dcd-8881-ebd5bbf003da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:31.512659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:31.513654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:31.514391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 36/68] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:31.518664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d8941-c001-4dcd-8881-ebd5bbf003da None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:31.586143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027270c-4795-46a1-ae84-94ea880c3093 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:31.619281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d8941-c001-4dcd-8881-ebd5bbf003da None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:31.619621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e010b0-88a7-4808-b1dd-b86c7de29506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:31.620381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e010b0-88a7-4808-b1dd-b86c7de29506 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.620728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e010b0-88a7-4808-b1dd-b86c7de29506 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.620942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e010b0-88a7-4808-b1dd-b86c7de29506 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.631832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e010b0-88a7-4808-b1dd-b86c7de29506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-09e010b0-88a7-4808-b1dd-b86c7de29506 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:31.639544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:31.640364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 33/69] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:31.646245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e010b0-88a7-4808-b1dd-b86c7de29506 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:31.659012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ce753-f83a-464e-bd18-cdd940659cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:31.659870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ce753-f83a-464e-bd18-cdd940659cb8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.660154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ce753-f83a-464e-bd18-cdd940659cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.660430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ce753-f83a-464e-bd18-cdd940659cb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.671229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ce753-f83a-464e-bd18-cdd940659cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-a38ce753-f83a-464e-bd18-cdd940659cb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:31.679478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:31.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 37/70] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:43:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:43:31.685919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc817-619e-4189-84f0-8a2c1bcbf48d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.686592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc817-619e-4189-84f0-8a2c1bcbf48d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.686592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc817-619e-4189-84f0-8a2c1bcbf48d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.686592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 38/71] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:31.686592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dc817-619e-4189-84f0-8a2c1bcbf48d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:31.746450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e010b0-88a7-4808-b1dd-b86c7de29506 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:31.777528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:31.778180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.778459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.778727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.779495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:31.779796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:31.781166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:31.783844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dc817-619e-4189-84f0-8a2c1bcbf48d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:31.789480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 34/72] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:31.790256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:31.817055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e05e-faff-467e-8443-2da1e0f73122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:31.817749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e05e-faff-467e-8443-2da1e0f73122 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.818032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e05e-faff-467e-8443-2da1e0f73122 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.818308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e05e-faff-467e-8443-2da1e0f73122 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.819618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e05e-faff-467e-8443-2da1e0f73122 None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:31.819923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e05e-faff-467e-8443-2da1e0f73122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:31.821319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e05e-faff-467e-8443-2da1e0f73122 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:31.828985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 39/73] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:31.828985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8247-5da6-432d-9e74-52d57973a0df None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.828985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8247-5da6-432d-9e74-52d57973a0df None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.828985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8247-5da6-432d-9e74-52d57973a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.847582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d59c8247-5da6-432d-9e74-52d57973a0df None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:31.848767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d59c8247-5da6-432d-9e74-52d57973a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:31.886324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacb3e4-152f-42b8-97af-1bc0d52f97f9 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:31.910947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 40/74] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:31.921657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b10fe-d6fc-44c2-a7c6-efdf69ddee3c None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.921657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b10fe-d6fc-44c2-a7c6-efdf69ddee3c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.921657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b10fe-d6fc-44c2-a7c6-efdf69ddee3c None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.921657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 41/75] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:31.921657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b10fe-d6fc-44c2-a7c6-efdf69ddee3c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:31.924812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:31.925480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:31.925757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:31.926027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:31.926785 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:31.927081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:31.929037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:31.937254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 35/76] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:31.938099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.013232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b10fe-d6fc-44c2-a7c6-efdf69ddee3c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.030213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7631ef7-d6a0-4dec-b931-ca22735fbcf6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.045120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36813d-ef5e-4c08-88fe-57390dbe5d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.045995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36813d-ef5e-4c08-88fe-57390dbe5d4c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.046277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36813d-ef5e-4c08-88fe-57390dbe5d4c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.046553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36813d-ef5e-4c08-88fe-57390dbe5d4c None admin] PATH_INFO: `/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.047773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36813d-ef5e-4c08-88fe-57390dbe5d4c None admin] RBAC: Authorizing `identity:get_user(user_id=2e7cd529baa6412fbb8c3f6158f7ed52)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.049210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36813d-ef5e-4c08-88fe-57390dbe5d4c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.050847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 42/77] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:31 2022] GET /identity/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:32.051998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e455b3e-63bd-477d-8505-27250a33c07a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.052286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e455b3e-63bd-477d-8505-27250a33c07a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.052565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e455b3e-63bd-477d-8505-27250a33c07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.061934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd17c-332f-4943-8190-43966dc77bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.062810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd17c-332f-4943-8190-43966dc77bf5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.063089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd17c-332f-4943-8190-43966dc77bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.063388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd17c-332f-4943-8190-43966dc77bf5 None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.068889 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9e455b3e-63bd-477d-8505-27250a33c07a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:32.070091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9e455b3e-63bd-477d-8505-27250a33c07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:32.078480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd17c-332f-4943-8190-43966dc77bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.079937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd17c-332f-4943-8190-43966dc77bf5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.081567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 36/78] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:31 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:32.086586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd17c-332f-4943-8190-43966dc77bf5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.136077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 43/79] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:32.136960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e455b3e-63bd-477d-8505-27250a33c07a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.176558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd17c-332f-4943-8190-43966dc77bf5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.211432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9a0b-c13b-421b-bcbc-9f0c625ad03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.212239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9a0b-c13b-421b-bcbc-9f0c625ad03a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.212530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9a0b-c13b-421b-bcbc-9f0c625ad03a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.212801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9a0b-c13b-421b-bcbc-9f0c625ad03a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.222844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f9a0b-c13b-421b-bcbc-9f0c625ad03a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-139f9a0b-c13b-421b-bcbc-9f0c625ad03a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:32.230600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:32.231591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 37/80] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:32.237402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9a0b-c13b-421b-bcbc-9f0c625ad03a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.238251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e455b3e-63bd-477d-8505-27250a33c07a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.265855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04971-f2bb-4509-80f4-88a76b586f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.266723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04971-f2bb-4509-80f4-88a76b586f5b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.267004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04971-f2bb-4509-80f4-88a76b586f5b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.267277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04971-f2bb-4509-80f4-88a76b586f5b None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.268495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04971-f2bb-4509-80f4-88a76b586f5b None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.269967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04971-f2bb-4509-80f4-88a76b586f5b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.272169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 44/81] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:32.272933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04971-f2bb-4509-80f4-88a76b586f5b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.327315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9a0b-c13b-421b-bcbc-9f0c625ad03a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.359353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ff705-3715-48d7-8e8a-768ac5c67734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.360000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff705-3715-48d7-8e8a-768ac5c67734 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.360283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff705-3715-48d7-8e8a-768ac5c67734 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.360556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff705-3715-48d7-8e8a-768ac5c67734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.366074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04971-f2bb-4509-80f4-88a76b586f5b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.397578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61214-2823-44f4-90c2-a6e5cbdd8f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.398144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61214-2823-44f4-90c2-a6e5cbdd8f3f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.398423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61214-2823-44f4-90c2-a6e5cbdd8f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.398693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61214-2823-44f4-90c2-a6e5cbdd8f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.424675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ff705-3715-48d7-8e8a-768ac5c67734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.426161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ff705-3715-48d7-8e8a-768ac5c67734 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.463958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61214-2823-44f4-90c2-a6e5cbdd8f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.465415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61214-2823-44f4-90c2-a6e5cbdd8f3f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.520403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 38/82] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:32.521258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ff705-3715-48d7-8e8a-768ac5c67734 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.555677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 45/83] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:32.555677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61214-2823-44f4-90c2-a6e5cbdd8f3f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.612790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ff705-3715-48d7-8e8a-768ac5c67734 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.644006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9e17-03de-4385-af99-a52c1fe532ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.644780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9e17-03de-4385-af99-a52c1fe532ef None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.645059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9e17-03de-4385-af99-a52c1fe532ef None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.645334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9e17-03de-4385-af99-a52c1fe532ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.646504 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb9e17-03de-4385-af99-a52c1fe532ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.648041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb9e17-03de-4385-af99-a52c1fe532ef None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.648932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61214-2823-44f4-90c2-a6e5cbdd8f3f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.649586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 39/84] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:32.650336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9e17-03de-4385-af99-a52c1fe532ef None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.681383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.682043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.682330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.682604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.683365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:32.683670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.685031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.692898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 46/85] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:32.692898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.745117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9e17-03de-4385-af99-a52c1fe532ef None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.776637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f109d20-20ed-4ff5-8f37-e4bbd1505350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.777338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f109d20-20ed-4ff5-8f37-e4bbd1505350 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.777631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f109d20-20ed-4ff5-8f37-e4bbd1505350 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.777909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f109d20-20ed-4ff5-8f37-e4bbd1505350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.794191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea4a11-1e6e-43d1-9b84-255c7be81a3e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.825928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea39bc-5223-4f2a-bab7-173ba3e6ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.826775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea39bc-5223-4f2a-bab7-173ba3e6ae93 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.827057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea39bc-5223-4f2a-bab7-173ba3e6ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.827342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea39bc-5223-4f2a-bab7-173ba3e6ae93 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.828510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea39bc-5223-4f2a-bab7-173ba3e6ae93 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.830221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea39bc-5223-4f2a-bab7-173ba3e6ae93 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.831931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 47/86] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:32.833808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea39bc-5223-4f2a-bab7-173ba3e6ae93 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.842735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f109d20-20ed-4ff5-8f37-e4bbd1505350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.844211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f109d20-20ed-4ff5-8f37-e4bbd1505350 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.926779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea39bc-5223-4f2a-bab7-173ba3e6ae93 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:32.935066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 40/87] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:32.936993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f109d20-20ed-4ff5-8f37-e4bbd1505350 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:32.958588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94b440-ed7b-4f66-990b-28dc910030ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:32.959985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94b440-ed7b-4f66-990b-28dc910030ce None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:32.960269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94b440-ed7b-4f66-990b-28dc910030ce None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:32.960544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94b440-ed7b-4f66-990b-28dc910030ce None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:32.961722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94b440-ed7b-4f66-990b-28dc910030ce None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:32.963165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94b440-ed7b-4f66-990b-28dc910030ce None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:32.964879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 48/88] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:32.970132 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94b440-ed7b-4f66-990b-28dc910030ce None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:33.029100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f109d20-20ed-4ff5-8f37-e4bbd1505350 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.061108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76cb31-4acc-4e0d-ad2e-b54dc5d11d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.061774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76cb31-4acc-4e0d-ad2e-b54dc5d11d85 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.062052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76cb31-4acc-4e0d-ad2e-b54dc5d11d85 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.062320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76cb31-4acc-4e0d-ad2e-b54dc5d11d85 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.063026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76cb31-4acc-4e0d-ad2e-b54dc5d11d85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.064561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76cb31-4acc-4e0d-ad2e-b54dc5d11d85 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.066553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94b440-ed7b-4f66-990b-28dc910030ce None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.103319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 41/89] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:43:32 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:33.103319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76cb31-4acc-4e0d-ad2e-b54dc5d11d85 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:33.103599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c075a7-2aca-4ae4-be00-7bf65be6e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.103599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c075a7-2aca-4ae4-be00-7bf65be6e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.103599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c075a7-2aca-4ae4-be00-7bf65be6e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.103599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c075a7-2aca-4ae4-be00-7bf65be6e2a3 None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.103925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c075a7-2aca-4ae4-be00-7bf65be6e2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.104767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c075a7-2aca-4ae4-be00-7bf65be6e2a3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.106660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 49/90] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:32 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:33.107328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c075a7-2aca-4ae4-be00-7bf65be6e2a3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:33.197617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76cb31-4acc-4e0d-ad2e-b54dc5d11d85 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.215396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c075a7-2aca-4ae4-be00-7bf65be6e2a3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.235470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.236218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.236505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.236782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.237643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=fd89398693a247abb18b91b7cd6b5840, user.id=2e7cd529baa6412fbb8c3f6158f7ed52) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:33.237960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.239556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.259818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 42/91] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:33 2022] GET /identity/v3/role_assignments?user.id=2e7cd529baa6412fbb8c3f6158f7ed52&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:33.259818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:33.262303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870656-2f51-4129-9bab-68ba619f6397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.263200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870656-2f51-4129-9bab-68ba619f6397 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.263515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870656-2f51-4129-9bab-68ba619f6397 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.263788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870656-2f51-4129-9bab-68ba619f6397 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.265130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870656-2f51-4129-9bab-68ba619f6397 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.266669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870656-2f51-4129-9bab-68ba619f6397 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.268921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 50/92] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:33 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:33.269765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870656-2f51-4129-9bab-68ba619f6397 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:33.380300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870656-2f51-4129-9bab-68ba619f6397 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.380675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb314622-d8b1-49ad-9a6a-5a1a293a5df4 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.418306 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee533e9-4276-4537-a20d-e7722d16c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.418539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.418983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee533e9-4276-4537-a20d-e7722d16c70c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.419083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.419269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee533e9-4276-4537-a20d-e7722d16c70c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.419398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.419575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee533e9-4276-4537-a20d-e7722d16c70c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.419665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.420797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] RBAC: Adding query filter params (role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=fd89398693a247abb18b91b7cd6b5840, user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:33.421119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.423011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.429733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 43/93] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:33 2022] GET /identity/v3/role_assignments?user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=39757d16971a48b6836913cd1908f48e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:33.430600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:33.499829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee533e9-4276-4537-a20d-e7722d16c70c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.501262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee533e9-4276-4537-a20d-e7722d16c70c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.554293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490773b-816b-4d2a-8691-9b5fcd29d17c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.592037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.593067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.593541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.594003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.595068 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] RBAC: Adding query filter params (role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=fd89398693a247abb18b91b7cd6b5840, user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:33.595605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.597284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.604159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 44/94] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:33 2022] GET /identity/v3/role_assignments?user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:33.614289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 51/95] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:33.620051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:33.745931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b939b7-ff36-4b07-af85-925c3a707951 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.783152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5ed2e-1cec-49d7-b043-d18801e277c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.784467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ed2e-1cec-49d7-b043-d18801e277c5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.784977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ed2e-1cec-49d7-b043-d18801e277c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.785457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ed2e-1cec-49d7-b043-d18801e277c5 None admin] PATH_INFO: `/v3/projects/4a6c1214a65c4125bf54acc0847f3b6d` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.787007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5ed2e-1cec-49d7-b043-d18801e277c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a6c1214a65c4125bf54acc0847f3b6d)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.788831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5ed2e-1cec-49d7-b043-d18801e277c5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.790824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 45/96] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:33 2022] GET /identity/v3/projects/4a6c1214a65c4125bf54acc0847f3b6d => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:33.800475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee533e9-4276-4537-a20d-e7722d16c70c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:33.907207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee533e9-4276-4537-a20d-e7722d16c70c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:33.942371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad095a2-512b-4f97-ba79-4199f8973959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:33.943041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad095a2-512b-4f97-ba79-4199f8973959 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:33.943407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad095a2-512b-4f97-ba79-4199f8973959 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:33.943780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad095a2-512b-4f97-ba79-4199f8973959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:33.944638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad095a2-512b-4f97-ba79-4199f8973959 None admin] RBAC: Adding query filter params (role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=4a6c1214a65c4125bf54acc0847f3b6d, user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:33.944952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad095a2-512b-4f97-ba79-4199f8973959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:33.946415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad095a2-512b-4f97-ba79-4199f8973959 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:33.952397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 52/97] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:33 2022] GET /identity/v3/role_assignments?user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3&scope.project.id=4a6c1214a65c4125bf54acc0847f3b6d&role.id=39757d16971a48b6836913cd1908f48e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:36.277228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cefcd6-e238-42b0-aca9-59328e6e80b5 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:36.278203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cefcd6-e238-42b0-aca9-59328e6e80b5 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:36.278674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cefcd6-e238-42b0-aca9-59328e6e80b5 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:36.280581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 46/98] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:36.292556 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d72bd8-fb09-475a-8d04-716d9654a46d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:36.293448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d72bd8-fb09-475a-8d04-716d9654a46d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:36.293915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d72bd8-fb09-475a-8d04-716d9654a46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:36.315454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-85d72bd8-fb09-475a-8d04-716d9654a46d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:36.316981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-85d72bd8-fb09-475a-8d04-716d9654a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:36.393627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 53/99] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:36.439662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cefcd6-e238-42b0-aca9-59328e6e80b5 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:36.509110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd224-bede-4724-a780-2af2392e3670 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:36.509702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd224-bede-4724-a780-2af2392e3670 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:36.510189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd224-bede-4724-a780-2af2392e3670 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:36.511816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 54/100] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:36.527792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d299d83-d62b-4ec7-b78f-8c14f3c74400 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:36.528379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d299d83-d62b-4ec7-b78f-8c14f3c74400 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:36.528871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d299d83-d62b-4ec7-b78f-8c14f3c74400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:36.561170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5d299d83-d62b-4ec7-b78f-8c14f3c74400 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:36.562986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5d299d83-d62b-4ec7-b78f-8c14f3c74400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:36.563361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cefcd6-e238-42b0-aca9-59328e6e80b5 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:36.598018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a299ede-fcac-4b52-bcb5-1cda14c5633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:36.599134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299ede-fcac-4b52-bcb5-1cda14c5633d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:36.600211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299ede-fcac-4b52-bcb5-1cda14c5633d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:36.600688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299ede-fcac-4b52-bcb5-1cda14c5633d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:36.616208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a299ede-fcac-4b52-bcb5-1cda14c5633d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-1a299ede-fcac-4b52-bcb5-1cda14c5633d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:36.629781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:36.630654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:36.631973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:36.635518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 47/101] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:36.641417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a299ede-fcac-4b52-bcb5-1cda14c5633d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:36.696092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 55/102] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:36.741294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d299d83-d62b-4ec7-b78f-8c14f3c74400 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:36.784299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a299ede-fcac-4b52-bcb5-1cda14c5633d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:36.821700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:36.822779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:36.823127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:36.823650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:36.824643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] RBAC: Adding query filter params (name=member) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:36.825153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:36.826782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:36.837395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 48/103] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:36.843126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:36.922836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d299d83-d62b-4ec7-b78f-8c14f3c74400 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:36.987724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc77c9-d4fd-4098-9af8-4bc2e4e90b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:36.988533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc77c9-d4fd-4098-9af8-4bc2e4e90b2a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:36.988818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc77c9-d4fd-4098-9af8-4bc2e4e90b2a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:36.989090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc77c9-d4fd-4098-9af8-4bc2e4e90b2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.007695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc77c9-d4fd-4098-9af8-4bc2e4e90b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:37.020494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335dfcb-a45f-461c-bfd9-1fa8ea3e405c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-a9cc77c9-d4fd-4098-9af8-4bc2e4e90b2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:37.022831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:37.023687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:37.024428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 56/104] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:43:37.025552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c864a-345d-48b4-9110-4938834d15e8 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.027590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c864a-345d-48b4-9110-4938834d15e8 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.027590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c864a-345d-48b4-9110-4938834d15e8 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.028265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 57/105] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:37.038416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c864a-345d-48b4-9110-4938834d15e8 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.075954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e307f08-0f08-4662-a053-b79c74d880e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.077104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307f08-0f08-4662-a053-b79c74d880e2 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.077383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307f08-0f08-4662-a053-b79c74d880e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.077650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e307f08-0f08-4662-a053-b79c74d880e2 None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.079580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e307f08-0f08-4662-a053-b79c74d880e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:37.081027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e307f08-0f08-4662-a053-b79c74d880e2 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:37.082842 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 49/106] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:36 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:37.085087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd2ed-c17c-4d13-94ab-7ce4554fd806 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.085371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd2ed-c17c-4d13-94ab-7ce4554fd806 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.085645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd2ed-c17c-4d13-94ab-7ce4554fd806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.109592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b4efd2ed-c17c-4d13-94ab-7ce4554fd806 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:37.110816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b4efd2ed-c17c-4d13-94ab-7ce4554fd806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:37.161073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c864a-345d-48b4-9110-4938834d15e8 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.184438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 50/107] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:37.185577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404777e-217e-422e-bcf0-0b420c874503 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.185901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404777e-217e-422e-bcf0-0b420c874503 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.186189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404777e-217e-422e-bcf0-0b420c874503 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.191399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 51/108] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:37.191399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404777e-217e-422e-bcf0-0b420c874503 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.209399 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43790900-7ca7-49aa-8535-f05bc59215fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.210078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43790900-7ca7-49aa-8535-f05bc59215fe None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.210363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43790900-7ca7-49aa-8535-f05bc59215fe None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.210638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43790900-7ca7-49aa-8535-f05bc59215fe None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.211423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43790900-7ca7-49aa-8535-f05bc59215fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:37.211737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43790900-7ca7-49aa-8535-f05bc59215fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:37.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43790900-7ca7-49aa-8535-f05bc59215fe None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:37.226465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 58/109] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:37.226465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb84c7-ee0e-429f-b435-73a39cff935d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.226465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb84c7-ee0e-429f-b435-73a39cff935d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.226465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb84c7-ee0e-429f-b435-73a39cff935d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.226465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 59/110] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:37.226465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8977e0a-1eb2-42ed-baae-4fc36e0a34d5 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.226465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8977e0a-1eb2-42ed-baae-4fc36e0a34d5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.226957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8977e0a-1eb2-42ed-baae-4fc36e0a34d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.244305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b8977e0a-1eb2-42ed-baae-4fc36e0a34d5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:37.245508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b8977e0a-1eb2-42ed-baae-4fc36e0a34d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:37.307621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404777e-217e-422e-bcf0-0b420c874503 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.316180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 60/111] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:37.328232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8977e0a-1eb2-42ed-baae-4fc36e0a34d5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.341077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c6e5-2d0b-442b-88aa-ed1c07cafed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.341954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c6e5-2d0b-442b-88aa-ed1c07cafed8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.342238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c6e5-2d0b-442b-88aa-ed1c07cafed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.342515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c6e5-2d0b-442b-88aa-ed1c07cafed8 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.343742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c6e5-2d0b-442b-88aa-ed1c07cafed8 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:37.345189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c6e5-2d0b-442b-88aa-ed1c07cafed8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:37.346896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 52/112] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:37.348739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c6e5-2d0b-442b-88aa-ed1c07cafed8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.420458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8977e0a-1eb2-42ed-baae-4fc36e0a34d5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.442382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c6e5-2d0b-442b-88aa-ed1c07cafed8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.452028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39f701-8724-40de-87aa-8999f6b217cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.452810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39f701-8724-40de-87aa-8999f6b217cd None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.453087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39f701-8724-40de-87aa-8999f6b217cd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.453359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39f701-8724-40de-87aa-8999f6b217cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.463600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39f701-8724-40de-87aa-8999f6b217cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-4e39f701-8724-40de-87aa-8999f6b217cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:37.471322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:37.472150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:37.472885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 61/113] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:37.473690 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ecdd8-003e-4745-829a-9799a05c3a7a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.474038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ecdd8-003e-4745-829a-9799a05c3a7a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.474262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ecdd8-003e-4745-829a-9799a05c3a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.477973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f695b64-0f68-4964-8d12-d3b478241a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.478868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f695b64-0f68-4964-8d12-d3b478241a8a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.479130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f695b64-0f68-4964-8d12-d3b478241a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.479424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f695b64-0f68-4964-8d12-d3b478241a8a None admin] PATH_INFO: `/v3/users/66943d3bd09b43909b116b79699ce70d` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.490752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-830ecdd8-003e-4745-829a-9799a05c3a7a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:37.491957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-830ecdd8-003e-4745-829a-9799a05c3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:37.492647 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f695b64-0f68-4964-8d12-d3b478241a8a None admin] RBAC: Authorizing `identity:get_user(user_id=66943d3bd09b43909b116b79699ce70d)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:37.494125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f695b64-0f68-4964-8d12-d3b478241a8a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:37.495842 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 53/114] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/users/66943d3bd09b43909b116b79699ce70d => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:37.497056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f40b0-8685-43ac-9535-db47d40d2ff6 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.497346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f40b0-8685-43ac-9535-db47d40d2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.497626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f40b0-8685-43ac-9535-db47d40d2ff6 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.499015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 54/115] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:37.499586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f40b0-8685-43ac-9535-db47d40d2ff6 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.560473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 62/116] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:37.564222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ecdd8-003e-4745-829a-9799a05c3a7a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.608737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f40b0-8685-43ac-9535-db47d40d2ff6 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.640144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6039-309e-4591-b048-5a51e3f4f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.640975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6039-309e-4591-b048-5a51e3f4f06e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.641256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6039-309e-4591-b048-5a51e3f4f06e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.641529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6039-309e-4591-b048-5a51e3f4f06e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.651677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f6039-309e-4591-b048-5a51e3f4f06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-160f6039-309e-4591-b048-5a51e3f4f06e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:37.659285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:37.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:37.661066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:37.661894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ecdd8-003e-4745-829a-9799a05c3a7a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.661998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 55/117] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:37.661998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6039-309e-4591-b048-5a51e3f4f06e None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.698725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d582-9e29-4367-a3d6-17f4e1c11672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.699653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d582-9e29-4367-a3d6-17f4e1c11672 None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.699941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d582-9e29-4367-a3d6-17f4e1c11672 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.700222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d582-9e29-4367-a3d6-17f4e1c11672 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840/users/7d4b065be8d84f7a92ccbfe9cd4d3af3/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.702227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78d582-9e29-4367-a3d6-17f4e1c11672 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd89398693a247abb18b91b7cd6b5840, user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:37.703735 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78d582-9e29-4367-a3d6-17f4e1c11672 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:37.717248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 63/118] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:37 2022] PUT /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840/users/7d4b065be8d84f7a92ccbfe9cd4d3af3/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:37.718622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926dce7-c73f-40b3-8766-142d2c89b318 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.718729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926dce7-c73f-40b3-8766-142d2c89b318 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.718986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926dce7-c73f-40b3-8766-142d2c89b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.736646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d926dce7-c73f-40b3-8766-142d2c89b318 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:37.737877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d926dce7-c73f-40b3-8766-142d2c89b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:37.763780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6039-309e-4591-b048-5a51e3f4f06e None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.798856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.800039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.800039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.800286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.801094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:37.801486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:37.803530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:37.811352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 64/119] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:37.812019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926dce7-c73f-40b3-8766-142d2c89b318 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.812631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 56/120] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:37.813315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:37.915340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926dce7-c73f-40b3-8766-142d2c89b318 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.917684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2512-2069-4f82-a50c-e32e69aee726 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:37.950011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794d58a-a173-416e-adb1-cbb18f2465b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.950729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d58a-a173-416e-adb1-cbb18f2465b1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.951050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d58a-a173-416e-adb1-cbb18f2465b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.951353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d58a-a173-416e-adb1-cbb18f2465b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.952480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdefee-44f5-4c01-a44d-c0268e9ba6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:37.953330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdefee-44f5-4c01-a44d-c0268e9ba6b0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:37.953621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdefee-44f5-4c01-a44d-c0268e9ba6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:37.953903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdefee-44f5-4c01-a44d-c0268e9ba6b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:37.955088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdefee-44f5-4c01-a44d-c0268e9ba6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:37.956593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdefee-44f5-4c01-a44d-c0268e9ba6b0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:37.962934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 57/121] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:37.962934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdefee-44f5-4c01-a44d-c0268e9ba6b0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.018688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794d58a-a173-416e-adb1-cbb18f2465b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.020632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794d58a-a173-416e-adb1-cbb18f2465b1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.057106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdefee-44f5-4c01-a44d-c0268e9ba6b0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.091038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.091655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.091934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.092202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.092946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] RBAC: Adding query filter params (name=member) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:38.093249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.094616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.103122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 58/122] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:38.103949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.121599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 65/123] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:38.123684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794d58a-a173-416e-adb1-cbb18f2465b1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.210619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38491119-16b8-4b61-af41-2e2bce2ef379 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.220215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794d58a-a173-416e-adb1-cbb18f2465b1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.245171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c56a2d-b425-40a1-b79b-d1d67b02c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.246059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56a2d-b425-40a1-b79b-d1d67b02c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.246342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56a2d-b425-40a1-b79b-d1d67b02c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.246618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56a2d-b425-40a1-b79b-d1d67b02c7a9 None admin] PATH_INFO: `/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.247851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c56a2d-b425-40a1-b79b-d1d67b02c7a9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e7cd529baa6412fbb8c3f6158f7ed52)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.249301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c56a2d-b425-40a1-b79b-d1d67b02c7a9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.250937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 59/124] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:38.251700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c56a2d-b425-40a1-b79b-d1d67b02c7a9 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.257789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c259ad-93da-493a-b094-cbc0f7160359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.258635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c259ad-93da-493a-b094-cbc0f7160359 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.258917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c259ad-93da-493a-b094-cbc0f7160359 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.259190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c259ad-93da-493a-b094-cbc0f7160359 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.269296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c259ad-93da-493a-b094-cbc0f7160359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-20c259ad-93da-493a-b094-cbc0f7160359 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:38.277937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:38.278805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 66/125] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:38.284549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c259ad-93da-493a-b094-cbc0f7160359 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.359232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c56a2d-b425-40a1-b79b-d1d67b02c7a9 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.377163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c259ad-93da-493a-b094-cbc0f7160359 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.391266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1478c6-ea7a-465f-8b2f-37c5ecddff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.391955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1478c6-ea7a-465f-8b2f-37c5ecddff49 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.392240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1478c6-ea7a-465f-8b2f-37c5ecddff49 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.392518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1478c6-ea7a-465f-8b2f-37c5ecddff49 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.393230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1478c6-ea7a-465f-8b2f-37c5ecddff49 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.394673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1478c6-ea7a-465f-8b2f-37c5ecddff49 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.411772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d89e67-7fb8-4a23-a86a-4bb73aac10f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.413325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d89e67-7fb8-4a23-a86a-4bb73aac10f5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.413577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d89e67-7fb8-4a23-a86a-4bb73aac10f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.413849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d89e67-7fb8-4a23-a86a-4bb73aac10f5 None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.415222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d89e67-7fb8-4a23-a86a-4bb73aac10f5 None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.416791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d89e67-7fb8-4a23-a86a-4bb73aac10f5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.422971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 67/126] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:38.422971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d89e67-7fb8-4a23-a86a-4bb73aac10f5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.425244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 60/127] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:43:38 2022] POST /identity/v3/projects => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:38.426088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1478c6-ea7a-465f-8b2f-37c5ecddff49 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.536773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1478c6-ea7a-465f-8b2f-37c5ecddff49 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.538801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d89e67-7fb8-4a23-a86a-4bb73aac10f5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.574400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f6650-ec6a-4674-9f52-41b407b08c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.575320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f6650-ec6a-4674-9f52-41b407b08c08 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.575601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f6650-ec6a-4674-9f52-41b407b08c08 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.575882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f6650-ec6a-4674-9f52-41b407b08c08 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.577128 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f6650-ec6a-4674-9f52-41b407b08c08 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.578637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f6650-ec6a-4674-9f52-41b407b08c08 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.578771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c063a8c-dfab-4600-b5f4-775fc9b87184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.579927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c063a8c-dfab-4600-b5f4-775fc9b87184 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.580432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c063a8c-dfab-4600-b5f4-775fc9b87184 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.586188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 61/128] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:38.586188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f6650-ec6a-4674-9f52-41b407b08c08 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.586359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c063a8c-dfab-4600-b5f4-775fc9b87184 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.588174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c063a8c-dfab-4600-b5f4-775fc9b87184 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.589992 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c063a8c-dfab-4600-b5f4-775fc9b87184 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.592509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 68/129] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:38.593553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c063a8c-dfab-4600-b5f4-775fc9b87184 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.711645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c063a8c-dfab-4600-b5f4-775fc9b87184 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.711841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f6650-ec6a-4674-9f52-41b407b08c08 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.746339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.746792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980a73-63ff-470e-985f-9777a1659c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.747009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.747307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.747592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.747704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980a73-63ff-470e-985f-9777a1659c62 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.747960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980a73-63ff-470e-985f-9777a1659c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.748238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980a73-63ff-470e-985f-9777a1659c62 None admin] PATH_INFO: `/v3/projects/4a6c1214a65c4125bf54acc0847f3b6d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.748418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:38.748633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.749482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe980a73-63ff-470e-985f-9777a1659c62 None admin] RBAC: Authorizing `identity:get_project(project_id=4a6c1214a65c4125bf54acc0847f3b6d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.750013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.751067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe980a73-63ff-470e-985f-9777a1659c62 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.753794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 69/130] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/projects/4a6c1214a65c4125bf54acc0847f3b6d => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:38.754719 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980a73-63ff-470e-985f-9777a1659c62 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.759161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 62/131] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:38.760896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.861775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980a73-63ff-470e-985f-9777a1659c62 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.870023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e69b4-a7e2-4463-b661-372766e0f17f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:38.896786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8094a9e-6e77-4baa-b476-a55662c03b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.897774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8094a9e-6e77-4baa-b476-a55662c03b44 None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.898134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8094a9e-6e77-4baa-b476-a55662c03b44 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.898483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8094a9e-6e77-4baa-b476-a55662c03b44 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840/users/2e7cd529baa6412fbb8c3f6158f7ed52/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.900548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8094a9e-6e77-4baa-b476-a55662c03b44 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd89398693a247abb18b91b7cd6b5840, user_id=2e7cd529baa6412fbb8c3f6158f7ed52, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.902137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8094a9e-6e77-4baa-b476-a55662c03b44 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.904371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:38.905083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:38.905378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:38.905659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:38.906706 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] RBAC: Adding query filter params (role.id=0bf71370710241c1a66971b7dc2b2b6a, scope.project.id=fd89398693a247abb18b91b7cd6b5840, user.id=66943d3bd09b43909b116b79699ce70d) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:38.907022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:38.909157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:38.916683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 63/132] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/role_assignments?user.id=66943d3bd09b43909b116b79699ce70d&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=0bf71370710241c1a66971b7dc2b2b6a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:38.917609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:38.919581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 70/133] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:38 2022] PUT /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840/users/2e7cd529baa6412fbb8c3f6158f7ed52/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:38.920623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8094a9e-6e77-4baa-b476-a55662c03b44 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:39.030386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8094a9e-6e77-4baa-b476-a55662c03b44 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:39.030572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f605618-bd34-4d6c-b7b8-9621372933fa None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:39.076905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b98d74-03c0-4602-bd00-ef6431b9704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:39.077116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8236f-48aa-431f-bf37-a1928e327f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:39.077826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b98d74-03c0-4602-bd00-ef6431b9704f None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:39.078103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b98d74-03c0-4602-bd00-ef6431b9704f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:39.078374 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b98d74-03c0-4602-bd00-ef6431b9704f None admin] PATH_INFO: `/v3/projects/4a6c1214a65c4125bf54acc0847f3b6d/users/7d4b065be8d84f7a92ccbfe9cd4d3af3/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:39.078897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8236f-48aa-431f-bf37-a1928e327f4d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:39.079407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8236f-48aa-431f-bf37-a1928e327f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:39.079878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8236f-48aa-431f-bf37-a1928e327f4d None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:39.080482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b98d74-03c0-4602-bd00-ef6431b9704f None admin] RBAC: Authorizing `identity:create_grant(project_id=4a6c1214a65c4125bf54acc0847f3b6d, user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:39.081606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8236f-48aa-431f-bf37-a1928e327f4d None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:39.081948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b98d74-03c0-4602-bd00-ef6431b9704f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:39.083538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8236f-48aa-431f-bf37-a1928e327f4d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:39.085541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 71/134] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:38 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:39.092486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8236f-48aa-431f-bf37-a1928e327f4d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:39.098110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 64/135] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:38 2022] PUT /identity/v3/projects/4a6c1214a65c4125bf54acc0847f3b6d/users/7d4b065be8d84f7a92ccbfe9cd4d3af3/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:39.229306 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8236f-48aa-431f-bf37-a1928e327f4d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:39.280959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b9488-da53-46cf-ba71-9f2925c8f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:39.282085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9488-da53-46cf-ba71-9f2925c8f660 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:39.282527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9488-da53-46cf-ba71-9f2925c8f660 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:39.282949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9488-da53-46cf-ba71-9f2925c8f660 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:39.284428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9488-da53-46cf-ba71-9f2925c8f660 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:39.286097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9488-da53-46cf-ba71-9f2925c8f660 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:39.288662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 72/136] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:39 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:39.294527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b98d74-03c0-4602-bd00-ef6431b9704f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:39.414544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b98d74-03c0-4602-bd00-ef6431b9704f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:39.460055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e182b61-5aff-4b51-b627-e26edd14325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:39.461239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182b61-5aff-4b51-b627-e26edd14325c None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:39.461686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182b61-5aff-4b51-b627-e26edd14325c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:39.462116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182b61-5aff-4b51-b627-e26edd14325c None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840/users/7d4b065be8d84f7a92ccbfe9cd4d3af3/roles/b522cd7d0a2e4208bd451e2a39c97d63` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:39.464745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e182b61-5aff-4b51-b627-e26edd14325c None admin] RBAC: Authorizing `identity:create_grant(project_id=fd89398693a247abb18b91b7cd6b5840, user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3, role_id=b522cd7d0a2e4208bd451e2a39c97d63)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:39.466378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e182b61-5aff-4b51-b627-e26edd14325c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:39.484707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 65/137] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:39 2022] PUT /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840/users/7d4b065be8d84f7a92ccbfe9cd4d3af3/roles/b522cd7d0a2e4208bd451e2a39c97d63 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:40.481213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2d19-2776-45b6-abf2-bf8027612feb None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:40.481879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2d19-2776-45b6-abf2-bf8027612feb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:40.481879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2d19-2776-45b6-abf2-bf8027612feb None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:40.483171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 73/138] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:40.497043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb582-3572-4cfe-92e5-8b53f7f58afe None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:40.497685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb582-3572-4cfe-92e5-8b53f7f58afe None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:40.497685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb582-3572-4cfe-92e5-8b53f7f58afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:40.522871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-80bdb582-3572-4cfe-92e5-8b53f7f58afe None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:40.524099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-80bdb582-3572-4cfe-92e5-8b53f7f58afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:40.605627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 66/139] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:40.640573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2d19-2776-45b6-abf2-bf8027612feb None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:40.761069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2d19-2776-45b6-abf2-bf8027612feb None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:40.802815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03308c40-5cbc-4890-aff8-681fe7d9e626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:40.803652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03308c40-5cbc-4890-aff8-681fe7d9e626 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:40.803937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03308c40-5cbc-4890-aff8-681fe7d9e626 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:40.804212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03308c40-5cbc-4890-aff8-681fe7d9e626 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:40.819383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03308c40-5cbc-4890-aff8-681fe7d9e626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-03308c40-5cbc-4890-aff8-681fe7d9e626 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:40.827495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:40.829539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:40.831572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 74/140] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:40.844426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb582-3572-4cfe-92e5-8b53f7f58afe None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:40.985356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb582-3572-4cfe-92e5-8b53f7f58afe None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:41.028611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:41.029216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:41.029493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:41.029767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:41.030522 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] RBAC: Adding query filter params (name=member) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:41.030823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:41.032242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:41.041128 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 67/141] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:41.046451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03308c40-5cbc-4890-aff8-681fe7d9e626 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:41.174731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03308c40-5cbc-4890-aff8-681fe7d9e626 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:41.228231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e08c12-0d2e-4b94-b0c1-676b41a329ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:41.229144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e08c12-0d2e-4b94-b0c1-676b41a329ff None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:41.229422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e08c12-0d2e-4b94-b0c1-676b41a329ff None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:41.229699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e08c12-0d2e-4b94-b0c1-676b41a329ff None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:41.231061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e08c12-0d2e-4b94-b0c1-676b41a329ff None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:41.232609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e08c12-0d2e-4b94-b0c1-676b41a329ff None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:41.234337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 75/142] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:41 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:41.240159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:41.344716 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe7072-a7ce-42ab-9034-62c65642e2bd None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:41.378705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5eec3-c778-4bd7-99c8-faa42688be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:41.379777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eec3-c778-4bd7-99c8-faa42688be31 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:41.380281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eec3-c778-4bd7-99c8-faa42688be31 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:41.380821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eec3-c778-4bd7-99c8-faa42688be31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:41.464797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec2dc-9229-4905-ab34-81cf7a79641b None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:41.465121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec2dc-9229-4905-ab34-81cf7a79641b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:41.465354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec2dc-9229-4905-ab34-81cf7a79641b None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:41.467380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 76/143] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:41.477296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac321-2196-4c97-a985-33f2ac9f3876 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:41.477612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac321-2196-4c97-a985-33f2ac9f3876 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:41.477864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac321-2196-4c97-a985-33f2ac9f3876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:41.485262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5eec3-c778-4bd7-99c8-faa42688be31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:41.487221 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5eec3-c778-4bd7-99c8-faa42688be31 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:41.508317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5c7ac321-2196-4c97-a985-33f2ac9f3876 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:41.510205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5c7ac321-2196-4c97-a985-33f2ac9f3876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:41.629983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 77/144] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:41.670772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ac321-2196-4c97-a985-33f2ac9f3876 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:41.726421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 68/145] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:41.731502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5eec3-c778-4bd7-99c8-faa42688be31 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:41.794768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ac321-2196-4c97-a985-33f2ac9f3876 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:41.833214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99239-fae5-442a-9e20-8b4f660f2dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:41.834308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99239-fae5-442a-9e20-8b4f660f2dc1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:41.835907 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99239-fae5-442a-9e20-8b4f660f2dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:41.836346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99239-fae5-442a-9e20-8b4f660f2dc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:41.838402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de99239-fae5-442a-9e20-8b4f660f2dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:41.842814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de99239-fae5-442a-9e20-8b4f660f2dc1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:41.844829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 78/146] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:41.851424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99239-fae5-442a-9e20-8b4f660f2dc1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:41.943048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5eec3-c778-4bd7-99c8-faa42688be31 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:41.994829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2155ad-d36e-4db2-a501-a5e2f534fc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:41.995728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2155ad-d36e-4db2-a501-a5e2f534fc75 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:41.996007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2155ad-d36e-4db2-a501-a5e2f534fc75 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:41.996278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2155ad-d36e-4db2-a501-a5e2f534fc75 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:41.997530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2155ad-d36e-4db2-a501-a5e2f534fc75 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:41.999033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2155ad-d36e-4db2-a501-a5e2f534fc75 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:42.001081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 69/147] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:41 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:42.006297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2155ad-d36e-4db2-a501-a5e2f534fc75 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:42.033428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99239-fae5-442a-9e20-8b4f660f2dc1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:42.114792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2155ad-d36e-4db2-a501-a5e2f534fc75 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:42.120917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd03ec-855a-4fb9-b75a-79d3d984dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:42.121619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd03ec-855a-4fb9-b75a-79d3d984dad1 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.121906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd03ec-855a-4fb9-b75a-79d3d984dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.122187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd03ec-855a-4fb9-b75a-79d3d984dad1 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.122927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd03ec-855a-4fb9-b75a-79d3d984dad1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:42.124413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd03ec-855a-4fb9-b75a-79d3d984dad1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:42.152874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b5645-372f-4301-9f4a-187eb421c010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:42.153726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5645-372f-4301-9f4a-187eb421c010 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.154013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5645-372f-4301-9f4a-187eb421c010 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.154351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5645-372f-4301-9f4a-187eb421c010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.155183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b5645-372f-4301-9f4a-187eb421c010 None admin] RBAC: Adding query filter params (role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=fd89398693a247abb18b91b7cd6b5840, user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:42.155571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b5645-372f-4301-9f4a-187eb421c010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:42.157052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b5645-372f-4301-9f4a-187eb421c010 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:42.164045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 70/148] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:42 2022] GET /identity/v3/role_assignments?user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=39757d16971a48b6836913cd1908f48e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:42.174415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 79/149] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:43:41 2022] POST /identity/v3/users => generated 283 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:43:42.271772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40dca9-124f-4819-a7cb-cd06ff3935c5 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.272092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40dca9-124f-4819-a7cb-cd06ff3935c5 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.272393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40dca9-124f-4819-a7cb-cd06ff3935c5 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.274189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 71/150] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:42.279731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c577-f98d-4530-b49b-a22d366b6d32 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.280032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c577-f98d-4530-b49b-a22d366b6d32 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.280300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309c577-f98d-4530-b49b-a22d366b6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.309434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8309c577-f98d-4530-b49b-a22d366b6d32 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:42.310648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8309c577-f98d-4530-b49b-a22d366b6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:42.413446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 80/151] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:42.447823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40dca9-124f-4819-a7cb-cd06ff3935c5 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:42.580771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40dca9-124f-4819-a7cb-cd06ff3935c5 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:42.623526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a165b-ceda-493b-99db-fc0ec13b7b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:42.624747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a165b-ceda-493b-99db-fc0ec13b7b8a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.625252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a165b-ceda-493b-99db-fc0ec13b7b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.626060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a165b-ceda-493b-99db-fc0ec13b7b8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.639965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a165b-ceda-493b-99db-fc0ec13b7b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-c76a165b-ceda-493b-99db-fc0ec13b7b8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:42.649432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:42.650343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:42.651085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:42.654088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 72/152] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:42.660428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309c577-f98d-4530-b49b-a22d366b6d32 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:42.772053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309c577-f98d-4530-b49b-a22d366b6d32 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:42.808459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:42.809516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.809990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.810500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.811591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:42.812103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:42.813738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:42.823088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 81/153] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:42.828160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:42.828713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15157f76-bf81-4881-8a95-fdc417534f9b None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.829545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15157f76-bf81-4881-8a95-fdc417534f9b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.830084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15157f76-bf81-4881-8a95-fdc417534f9b None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.834478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 73/154] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:42.835999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836f48d-0da7-4b2b-8147-c699358674c4 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.836487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836f48d-0da7-4b2b-8147-c699358674c4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.836975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836f48d-0da7-4b2b-8147-c699358674c4 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.838434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 74/155] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:42.844232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b143ae-6a74-4ad4-ad8e-be9bc3534394 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.844600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b143ae-6a74-4ad4-ad8e-be9bc3534394 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.844950 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b143ae-6a74-4ad4-ad8e-be9bc3534394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.866450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-90b143ae-6a74-4ad4-ad8e-be9bc3534394 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:42.867932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-90b143ae-6a74-4ad4-ad8e-be9bc3534394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:42.952549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3c68-17e6-4ea8-a657-fea75ba5f17a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:42.953518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 75/156] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:42.957023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d2e3-8966-4118-8bf9-d1c4c3f2b0db None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:42.957023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d2e3-8966-4118-8bf9-d1c4c3f2b0db None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:42.957023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d2e3-8966-4118-8bf9-d1c4c3f2b0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:42.976401 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-5662d2e3-8966-4118-8bf9-d1c4c3f2b0db None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:42.978303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5662d2e3-8966-4118-8bf9-d1c4c3f2b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:43.012014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8cf40-93ec-468d-aa1c-030c9f2d6d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.013208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cf40-93ec-468d-aa1c-030c9f2d6d9b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.013670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cf40-93ec-468d-aa1c-030c9f2d6d9b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.014120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cf40-93ec-468d-aa1c-030c9f2d6d9b None admin] PATH_INFO: `/v3/users/66943d3bd09b43909b116b79699ce70d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.015525 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8cf40-93ec-468d-aa1c-030c9f2d6d9b None admin] RBAC: Authorizing `identity:get_user(user_id=66943d3bd09b43909b116b79699ce70d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:43.017170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8cf40-93ec-468d-aa1c-030c9f2d6d9b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:43.019271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 82/157] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:42 2022] GET /identity/v3/users/66943d3bd09b43909b116b79699ce70d => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:43.020224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8cf40-93ec-468d-aa1c-030c9f2d6d9b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.062977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 76/158] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:43.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662d2e3-8966-4118-8bf9-d1c4c3f2b0db None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.154501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8cf40-93ec-468d-aa1c-030c9f2d6d9b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:43.186722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662d2e3-8966-4118-8bf9-d1c4c3f2b0db None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:43.191324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fdae0-cc9c-455d-ab70-d32452591316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.192121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fdae0-cc9c-455d-ab70-d32452591316 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.192395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fdae0-cc9c-455d-ab70-d32452591316 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.192664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fdae0-cc9c-455d-ab70-d32452591316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.204967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fdae0-cc9c-455d-ab70-d32452591316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-7f8fdae0-cc9c-455d-ab70-d32452591316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:43.212318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:43.213159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:43.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 83/159] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:43.214535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fdae0-cc9c-455d-ab70-d32452591316 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.237796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e8d1-93ec-470f-bfaa-27311a3d072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.239545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e8d1-93ec-470f-bfaa-27311a3d072a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.239545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e8d1-93ec-470f-bfaa-27311a3d072a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.241448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e8d1-93ec-470f-bfaa-27311a3d072a None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.242363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e8d1-93ec-470f-bfaa-27311a3d072a None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:43.243969 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e8d1-93ec-470f-bfaa-27311a3d072a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:43.245982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 77/160] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:43.247307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3305e5-2cf8-491a-97c7-1ac80e8f4976 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.247685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3305e5-2cf8-491a-97c7-1ac80e8f4976 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.248040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3305e5-2cf8-491a-97c7-1ac80e8f4976 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.251472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 78/161] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:43.252260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3305e5-2cf8-491a-97c7-1ac80e8f4976 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.335457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fdae0-cc9c-455d-ab70-d32452591316 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:43.370487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b0922-d5fc-4e4e-9374-40b1e988cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.371290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b0922-d5fc-4e4e-9374-40b1e988cde8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.371601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b0922-d5fc-4e4e-9374-40b1e988cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.371875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b0922-d5fc-4e4e-9374-40b1e988cde8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.385059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3305e5-2cf8-491a-97c7-1ac80e8f4976 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:43.385220 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b0922-d5fc-4e4e-9374-40b1e988cde8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-fa6b0922-d5fc-4e4e-9374-40b1e988cde8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:43.392951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:43.394068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:43.394901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 84/162] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:43.396230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b0922-d5fc-4e4e-9374-40b1e988cde8 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.432968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c35d8-0415-4a88-a9dc-5a40db6064f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.433996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c35d8-0415-4a88-a9dc-5a40db6064f1 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.434555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c35d8-0415-4a88-a9dc-5a40db6064f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.434837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c35d8-0415-4a88-a9dc-5a40db6064f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.435811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c35d8-0415-4a88-a9dc-5a40db6064f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:43.436125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c35d8-0415-4a88-a9dc-5a40db6064f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:43.438125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c35d8-0415-4a88-a9dc-5a40db6064f1 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:43.452212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 79/163] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:43.454039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c517-8f1d-46c6-921d-c87e206b8539 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.454616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c517-8f1d-46c6-921d-c87e206b8539 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.454899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c517-8f1d-46c6-921d-c87e206b8539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.485492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-efe7c517-8f1d-46c6-921d-c87e206b8539 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:43.486682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-efe7c517-8f1d-46c6-921d-c87e206b8539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:43.550626 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b0922-d5fc-4e4e-9374-40b1e988cde8 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:43.623206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff385b-8428-4f3e-bda6-722d3adaebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.626234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff385b-8428-4f3e-bda6-722d3adaebfd None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.626521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff385b-8428-4f3e-bda6-722d3adaebfd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.626796 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff385b-8428-4f3e-bda6-722d3adaebfd None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840/users/66943d3bd09b43909b116b79699ce70d/roles/0bf71370710241c1a66971b7dc2b2b6a` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.627187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 80/164] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:43.629025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c517-8f1d-46c6-921d-c87e206b8539 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.630923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff385b-8428-4f3e-bda6-722d3adaebfd None admin] RBAC: Authorizing `identity:create_grant(project_id=fd89398693a247abb18b91b7cd6b5840, user_id=66943d3bd09b43909b116b79699ce70d, role_id=0bf71370710241c1a66971b7dc2b2b6a)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:43.632427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff385b-8428-4f3e-bda6-722d3adaebfd None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:43.654605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 85/165] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:43 2022] PUT /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840/users/66943d3bd09b43909b116b79699ce70d/roles/0bf71370710241c1a66971b7dc2b2b6a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:43.655475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff385b-8428-4f3e-bda6-722d3adaebfd None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.780540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff385b-8428-4f3e-bda6-722d3adaebfd None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:43.799703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c517-8f1d-46c6-921d-c87e206b8539 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:43.818831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe6688-e027-469c-8dde-a0133c64c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.819775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6688-e027-469c-8dde-a0133c64c35b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.820054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6688-e027-469c-8dde-a0133c64c35b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.820324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6688-e027-469c-8dde-a0133c64c35b None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.821560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe6688-e027-469c-8dde-a0133c64c35b None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:43.823036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe6688-e027-469c-8dde-a0133c64c35b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:43.824750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 86/166] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:43.825536 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe6688-e027-469c-8dde-a0133c64c35b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.869708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.870399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.870661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.870933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.871728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:43.872034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:43.873560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:43.890909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 81/167] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:43.891814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:43.934251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe6688-e027-469c-8dde-a0133c64c35b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:43.970175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacea7d7-7fca-45e3-8a63-cf20378923e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:43.970994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea7d7-7fca-45e3-8a63-cf20378923e3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:43.971276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea7d7-7fca-45e3-8a63-cf20378923e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:43.971571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea7d7-7fca-45e3-8a63-cf20378923e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:43.982962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacea7d7-7fca-45e3-8a63-cf20378923e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-bacea7d7-7fca-45e3-8a63-cf20378923e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:43.991741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:43.992632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:43.993388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 87/168] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:43.994027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacea7d7-7fca-45e3-8a63-cf20378923e3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:44.103722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacea7d7-7fca-45e3-8a63-cf20378923e3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:44.107650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4201e-2e33-48e0-9097-7549d441c853 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:44.138040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d49e8-0e14-4806-aa4c-44c5b16efdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:44.138976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d49e8-0e14-4806-aa4c-44c5b16efdec None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:44.139240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d49e8-0e14-4806-aa4c-44c5b16efdec None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:44.139543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d49e8-0e14-4806-aa4c-44c5b16efdec None admin] PATH_INFO: `/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:44.141051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d49e8-0e14-4806-aa4c-44c5b16efdec None admin] RBAC: Authorizing `identity:get_user(user_id=2e7cd529baa6412fbb8c3f6158f7ed52)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:44.142526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d49e8-0e14-4806-aa4c-44c5b16efdec None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:44.145383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 88/169] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/users/2e7cd529baa6412fbb8c3f6158f7ed52 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:44.145383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d49e8-0e14-4806-aa4c-44c5b16efdec None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:44.176926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5cda5-1799-497e-9fe7-e08640b674ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:44.177878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5cda5-1799-497e-9fe7-e08640b674ef None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:44.178283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5cda5-1799-497e-9fe7-e08640b674ef None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:44.178716 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5cda5-1799-497e-9fe7-e08640b674ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:44.247588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d49e8-0e14-4806-aa4c-44c5b16efdec None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:44.282341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:44.283110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:44.283435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:44.283808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:44.287316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:44.287316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:44.287316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:44.294851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 89/170] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:43:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:44.297602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:44.357541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5cda5-1799-497e-9fe7-e08640b674ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:44.358953 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5cda5-1799-497e-9fe7-e08640b674ef None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:44.403203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba03c-ed1c-471f-818e-890650d36c74 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:44.438177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cab2d3-d24b-47f7-a90f-5a9aa726057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:44.438830 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab2d3-d24b-47f7-a90f-5a9aa726057b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:44.439108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab2d3-d24b-47f7-a90f-5a9aa726057b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:44.439405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab2d3-d24b-47f7-a90f-5a9aa726057b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:44.509461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cab2d3-d24b-47f7-a90f-5a9aa726057b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:44.510940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cab2d3-d24b-47f7-a90f-5a9aa726057b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:44.547627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 82/171] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:44.548482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5cda5-1799-497e-9fe7-e08640b674ef None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:44.616573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 90/172] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:44.617342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cab2d3-d24b-47f7-a90f-5a9aa726057b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:44.715753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cab2d3-d24b-47f7-a90f-5a9aa726057b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:44.749189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43983-082b-4b3c-b5f3-09169f54dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:44.750313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43983-082b-4b3c-b5f3-09169f54dd19 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:44.750749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43983-082b-4b3c-b5f3-09169f54dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:44.751158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43983-082b-4b3c-b5f3-09169f54dd19 None admin] PATH_INFO: `/v3/projects/4a6c1214a65c4125bf54acc0847f3b6d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:44.752509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43983-082b-4b3c-b5f3-09169f54dd19 None admin] RBAC: Authorizing `identity:get_project(project_id=4a6c1214a65c4125bf54acc0847f3b6d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:44.754099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43983-082b-4b3c-b5f3-09169f54dd19 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:44.756520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 91/173] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:44 2022] GET /identity/v3/projects/4a6c1214a65c4125bf54acc0847f3b6d => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:44.757432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43983-082b-4b3c-b5f3-09169f54dd19 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:44.798627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5cda5-1799-497e-9fe7-e08640b674ef None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:44.872313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fd6f7-2b46-441e-9171-b9ef3089a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:44.873209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fd6f7-2b46-441e-9171-b9ef3089a112 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:44.873490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fd6f7-2b46-441e-9171-b9ef3089a112 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:44.873769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fd6f7-2b46-441e-9171-b9ef3089a112 None admin] PATH_INFO: `/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:44.875118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fd6f7-2b46-441e-9171-b9ef3089a112 None admin] RBAC: Authorizing `identity:get_user(user_id=7d4b065be8d84f7a92ccbfe9cd4d3af3)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:44.876639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fd6f7-2b46-441e-9171-b9ef3089a112 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:44.878749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 83/174] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:44 2022] GET /identity/v3/users/7d4b065be8d84f7a92ccbfe9cd4d3af3 => generated 275 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:44.879618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fd6f7-2b46-441e-9171-b9ef3089a112 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:44.906510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43983-082b-4b3c-b5f3-09169f54dd19 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:44.942126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829d187-ea49-4924-8e20-34c0264d737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:44.943346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d187-ea49-4924-8e20-34c0264d737a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:44.943795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d187-ea49-4924-8e20-34c0264d737a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:44.944229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d187-ea49-4924-8e20-34c0264d737a None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:44.945712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829d187-ea49-4924-8e20-34c0264d737a None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:44.947392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829d187-ea49-4924-8e20-34c0264d737a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:44.949511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 92/175] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:44 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:44.950424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829d187-ea49-4924-8e20-34c0264d737a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:45.042161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fd6f7-2b46-441e-9171-b9ef3089a112 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:45.052110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829d187-ea49-4924-8e20-34c0264d737a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:45.087193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171999a7-d91f-4065-9cb3-db1b5bd22d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:45.089606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171999a7-d91f-4065-9cb3-db1b5bd22d3e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:45.090188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171999a7-d91f-4065-9cb3-db1b5bd22d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:45.091706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171999a7-d91f-4065-9cb3-db1b5bd22d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:45.106170 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:45.107148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:45.107674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:45.108084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:45.109086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] RBAC: Adding query filter params (role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=4a6c1214a65c4125bf54acc0847f3b6d, user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:45.109536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:45.111119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:45.126104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 84/176] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:44 2022] GET /identity/v3/role_assignments?user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3&scope.project.id=4a6c1214a65c4125bf54acc0847f3b6d&role.id=39757d16971a48b6836913cd1908f48e => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:45.126619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:45.236193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171999a7-d91f-4065-9cb3-db1b5bd22d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:45.237697 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171999a7-d91f-4065-9cb3-db1b5bd22d3e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:45.280168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063615-beb2-4172-9865-bf6b491a1c61 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:45.322205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:45.322878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:45.323158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:45.323459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:45.324360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=fd89398693a247abb18b91b7cd6b5840, user.id=2e7cd529baa6412fbb8c3f6158f7ed52) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:45.324677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:45.326133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:45.335865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 85/177] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:45 2022] GET /identity/v3/role_assignments?user.id=2e7cd529baa6412fbb8c3f6158f7ed52&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:45.416580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 93/178] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:45.422197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:45.545784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f573-fa8a-4ca9-9848-dece3ba3e5b6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:45.591005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb5f32-a797-4756-9b91-3b000c75f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:45.591918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5f32-a797-4756-9b91-3b000c75f76a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:45.592202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5f32-a797-4756-9b91-3b000c75f76a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:45.592477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5f32-a797-4756-9b91-3b000c75f76a None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:45.593697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb5f32-a797-4756-9b91-3b000c75f76a None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:45.595178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb5f32-a797-4756-9b91-3b000c75f76a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:45.596975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 86/179] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:45 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:45.603730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171999a7-d91f-4065-9cb3-db1b5bd22d3e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:45.735454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171999a7-d91f-4065-9cb3-db1b5bd22d3e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:45.777192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dd569-8133-430c-aa8f-e488ab4ad3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:45.778303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dd569-8133-430c-aa8f-e488ab4ad3bc None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:45.778782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dd569-8133-430c-aa8f-e488ab4ad3bc None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:45.779320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dd569-8133-430c-aa8f-e488ab4ad3bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:45.780362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dd569-8133-430c-aa8f-e488ab4ad3bc None admin] RBAC: Adding query filter params (role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=fd89398693a247abb18b91b7cd6b5840, user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:45.780897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dd569-8133-430c-aa8f-e488ab4ad3bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:45.782539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dd569-8133-430c-aa8f-e488ab4ad3bc None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:45.790011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 94/180] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:45 2022] GET /identity/v3/role_assignments?user.id=7d4b065be8d84f7a92ccbfe9cd4d3af3&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:46.136561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8daac2-6767-47ff-a0de-5cc9e2c21851 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.137036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8daac2-6767-47ff-a0de-5cc9e2c21851 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.137036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8daac2-6767-47ff-a0de-5cc9e2c21851 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.138714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 87/181] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:46.143887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1b22-84b4-4142-9c47-d1c5bf3751d4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.144336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1b22-84b4-4142-9c47-d1c5bf3751d4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.144517 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1b22-84b4-4142-9c47-d1c5bf3751d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.168404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9c4b1b22-84b4-4142-9c47-d1c5bf3751d4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:46.169629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9c4b1b22-84b4-4142-9c47-d1c5bf3751d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:46.277759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 95/182] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:46.303271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8daac2-6767-47ff-a0de-5cc9e2c21851 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:46.412065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8daac2-6767-47ff-a0de-5cc9e2c21851 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:46.442029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633602-4ffc-4b20-a416-23cde57d98ee None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.442336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633602-4ffc-4b20-a416-23cde57d98ee None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.442601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633602-4ffc-4b20-a416-23cde57d98ee None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.444822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 96/183] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:46.452249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60347f-2953-4e45-ac05-b73a7222407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:46.453059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60347f-2953-4e45-ac05-b73a7222407f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.453338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60347f-2953-4e45-ac05-b73a7222407f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.453608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60347f-2953-4e45-ac05-b73a7222407f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.459209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5fbdb-e234-4f17-bda0-840d3f287d34 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.459792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5fbdb-e234-4f17-bda0-840d3f287d34 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.460266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5fbdb-e234-4f17-bda0-840d3f287d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.467760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60347f-2953-4e45-ac05-b73a7222407f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-fd60347f-2953-4e45-ac05-b73a7222407f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:46.477968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:46.478910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:46.480024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 88/184] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:46.484552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-18c5fbdb-e234-4f17-bda0-840d3f287d34 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:46.485389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60347f-2953-4e45-ac05-b73a7222407f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:46.486375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-18c5fbdb-e234-4f17-bda0-840d3f287d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:46.573880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 97/185] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:46.602781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5fbdb-e234-4f17-bda0-840d3f287d34 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:46.609033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60347f-2953-4e45-ac05-b73a7222407f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:46.652289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:46.653506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.654100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.654586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.655908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:46.656418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:46.658804 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:46.671060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 89/186] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:46.678546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:46.715785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5fbdb-e234-4f17-bda0-840d3f287d34 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:46.750813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb00293-b7f5-4697-a1da-5f523d595bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:46.751934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb00293-b7f5-4697-a1da-5f523d595bd3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.752398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb00293-b7f5-4697-a1da-5f523d595bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.752864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb00293-b7f5-4697-a1da-5f523d595bd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.754216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb00293-b7f5-4697-a1da-5f523d595bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:46.756476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb00293-b7f5-4697-a1da-5f523d595bd3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:46.758413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 98/187] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:46.762886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451e2a-8777-4a4a-9a4a-cd9506078ab1 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.762886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451e2a-8777-4a4a-9a4a-cd9506078ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.762886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451e2a-8777-4a4a-9a4a-cd9506078ab1 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.762886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 99/188] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:46.763662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451e2a-8777-4a4a-9a4a-cd9506078ab1 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:46.783160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3905a1f-901d-4799-ac93-5b61e1814516 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:46.816470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1619395-295c-411a-8fda-256d3a8674e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:46.817344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1619395-295c-411a-8fda-256d3a8674e9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.817628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1619395-295c-411a-8fda-256d3a8674e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.817897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1619395-295c-411a-8fda-256d3a8674e9 None admin] PATH_INFO: `/v3/users/249af81fd8fd4732b1b447f068587a1b` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.830981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1619395-295c-411a-8fda-256d3a8674e9 None admin] RBAC: Authorizing `identity:get_user(user_id=249af81fd8fd4732b1b447f068587a1b)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:46.832479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1619395-295c-411a-8fda-256d3a8674e9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:46.834187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 90/189] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:46 2022] GET /identity/v3/users/249af81fd8fd4732b1b447f068587a1b => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:46.836044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde44d8-9998-40a8-b1c6-fd06243cafa2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.836044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde44d8-9998-40a8-b1c6-fd06243cafa2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.836044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde44d8-9998-40a8-b1c6-fd06243cafa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.853345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-abde44d8-9998-40a8-b1c6-fd06243cafa2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:46.854505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-abde44d8-9998-40a8-b1c6-fd06243cafa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:46.867075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451e2a-8777-4a4a-9a4a-cd9506078ab1 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:46.899854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b5b7-5438-48c1-943e-bc50043cb96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:46.900513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b5b7-5438-48c1-943e-bc50043cb96c None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.900793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b5b7-5438-48c1-943e-bc50043cb96c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.901065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b5b7-5438-48c1-943e-bc50043cb96c None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.901831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b5b7-5438-48c1-943e-bc50043cb96c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:46.903272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b5b7-5438-48c1-943e-bc50043cb96c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:46.919070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 91/190] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:46.920103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde44d8-9998-40a8-b1c6-fd06243cafa2 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:46.933834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 100/191] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:43:46 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:46.933834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321160-b79e-4118-a54a-15e0e2c93f83 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.933834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321160-b79e-4118-a54a-15e0e2c93f83 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.933834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321160-b79e-4118-a54a-15e0e2c93f83 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.933834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 101/192] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:46.936407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1ae3d-1d14-403b-8de2-4698c665eaf7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:46.936916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1ae3d-1d14-403b-8de2-4698c665eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:46.937345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1ae3d-1d14-403b-8de2-4698c665eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:46.956357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3fa1ae3d-1d14-403b-8de2-4698c665eaf7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:46.957665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3fa1ae3d-1d14-403b-8de2-4698c665eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:47.032099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde44d8-9998-40a8-b1c6-fd06243cafa2 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.034515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 102/193] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:47.035592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1ae3d-1d14-403b-8de2-4698c665eaf7 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.068747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f5ca2-180c-4881-a4fb-bbc6575cbb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.069418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f5ca2-180c-4881-a4fb-bbc6575cbb53 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.069689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f5ca2-180c-4881-a4fb-bbc6575cbb53 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.069959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f5ca2-180c-4881-a4fb-bbc6575cbb53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.136656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1ae3d-1d14-403b-8de2-4698c665eaf7 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.140163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f5ca2-180c-4881-a4fb-bbc6575cbb53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:47.142257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f5ca2-180c-4881-a4fb-bbc6575cbb53 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:47.173837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1efac2-34c2-445d-9039-5fb4ebb3e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.174647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1efac2-34c2-445d-9039-5fb4ebb3e1ee None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.174923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1efac2-34c2-445d-9039-5fb4ebb3e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.175190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1efac2-34c2-445d-9039-5fb4ebb3e1ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.186648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1efac2-34c2-445d-9039-5fb4ebb3e1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-af1efac2-34c2-445d-9039-5fb4ebb3e1ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:47.198218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:47.199120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:47.199933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 103/194] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:47.200649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1efac2-34c2-445d-9039-5fb4ebb3e1ee None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.247685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 92/195] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:47.248606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f5ca2-180c-4881-a4fb-bbc6575cbb53 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.315112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1efac2-34c2-445d-9039-5fb4ebb3e1ee None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.350719 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d132-ecee-46f5-9be5-359364b6a604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.351131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f5ca2-180c-4881-a4fb-bbc6575cbb53 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.351543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d132-ecee-46f5-9be5-359364b6a604 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.351822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d132-ecee-46f5-9be5-359364b6a604 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.352092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d132-ecee-46f5-9be5-359364b6a604 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.363603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d132-ecee-46f5-9be5-359364b6a604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-8069d132-ecee-46f5-9be5-359364b6a604 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:47.371455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:47.372410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:47.373179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 104/196] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:47.374133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d132-ecee-46f5-9be5-359364b6a604 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.391051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.391858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.392137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.392408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.393231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:47.393584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:47.395003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:47.404636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 93/197] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:47.405478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.482038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d132-ecee-46f5-9be5-359364b6a604 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.507784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ff48-8e2d-43d5-9732-0266871eafe7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.516500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751bada-e092-4987-84bd-f28011d81378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.517369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751bada-e092-4987-84bd-f28011d81378 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.517643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751bada-e092-4987-84bd-f28011d81378 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.517913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751bada-e092-4987-84bd-f28011d81378 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.519102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751bada-e092-4987-84bd-f28011d81378 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:47.520617 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751bada-e092-4987-84bd-f28011d81378 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:47.522901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 105/198] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:47.523795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751bada-e092-4987-84bd-f28011d81378 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.544299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.545037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.545325 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.545602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.546358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:47.546665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:47.548134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:47.556772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 94/199] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:47.557571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.634509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751bada-e092-4987-84bd-f28011d81378 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.676691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917576a0-abbf-4ec3-9a9b-93019a48ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.677637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917576a0-abbf-4ec3-9a9b-93019a48ea4d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.677869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917576a0-abbf-4ec3-9a9b-93019a48ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.678131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917576a0-abbf-4ec3-9a9b-93019a48ea4d None admin] PATH_INFO: `/v3/users/249af81fd8fd4732b1b447f068587a1b` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.679526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917576a0-abbf-4ec3-9a9b-93019a48ea4d None admin] RBAC: Authorizing `identity:get_user(user_id=249af81fd8fd4732b1b447f068587a1b)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:47.681014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917576a0-abbf-4ec3-9a9b-93019a48ea4d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:47.682828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 106/200] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/users/249af81fd8fd4732b1b447f068587a1b => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:47.683514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917576a0-abbf-4ec3-9a9b-93019a48ea4d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.686432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc674e-04b8-407d-9100-6be337531a49 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.730066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.730729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.731009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.731479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.732751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=f0730edd303b4a70a18988aaf37dbc60, user.id=249af81fd8fd4732b1b447f068587a1b) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:47.733293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:47.734921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:47.742664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 95/201] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/role_assignments?user.id=249af81fd8fd4732b1b447f068587a1b&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:47.743340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.802337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917576a0-abbf-4ec3-9a9b-93019a48ea4d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.851328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d43b07-bd56-49ad-a72a-4d9f443dbe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.853163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43b07-bd56-49ad-a72a-4d9f443dbe5f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.853438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43b07-bd56-49ad-a72a-4d9f443dbe5f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.859323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43b07-bd56-49ad-a72a-4d9f443dbe5f None admin] PATH_INFO: `/v3/users/66943d3bd09b43909b116b79699ce70d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:47.859633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d8ba-cc99-40e8-a06f-b9080dbc3ba7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:47.859804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d43b07-bd56-49ad-a72a-4d9f443dbe5f None admin] RBAC: Authorizing `identity:get_user(user_id=66943d3bd09b43909b116b79699ce70d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:47.861184 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d43b07-bd56-49ad-a72a-4d9f443dbe5f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:47.868438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 107/202] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/users/66943d3bd09b43909b116b79699ce70d => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:47.869663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d43b07-bd56-49ad-a72a-4d9f443dbe5f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:47.923151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2ce5d-cd3d-4262-b2f8-d44f28cef6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:47.924077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ce5d-cd3d-4262-b2f8-d44f28cef6ae None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:47.924357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ce5d-cd3d-4262-b2f8-d44f28cef6ae None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:47.926006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ce5d-cd3d-4262-b2f8-d44f28cef6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:48.043760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d43b07-bd56-49ad-a72a-4d9f443dbe5f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:48.045599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2ce5d-cd3d-4262-b2f8-d44f28cef6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:48.047896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2ce5d-cd3d-4262-b2f8-d44f28cef6ae None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:48.093412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7aee9-65db-4610-929c-5edb600b562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:48.094066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7aee9-65db-4610-929c-5edb600b562d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:48.094345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7aee9-65db-4610-929c-5edb600b562d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:48.094619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7aee9-65db-4610-929c-5edb600b562d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:48.192450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 96/203] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:48.198049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2ce5d-cd3d-4262-b2f8-d44f28cef6ae None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:48.221601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7aee9-65db-4610-929c-5edb600b562d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:48.223093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7aee9-65db-4610-929c-5edb600b562d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:48.297466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2ce5d-cd3d-4262-b2f8-d44f28cef6ae None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:48.338217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879631c-872e-44cc-b185-af9b92cc65ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:48.339111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879631c-872e-44cc-b185-af9b92cc65ec None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:48.339406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879631c-872e-44cc-b185-af9b92cc65ec None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:48.339676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879631c-872e-44cc-b185-af9b92cc65ec None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:48.341118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879631c-872e-44cc-b185-af9b92cc65ec None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:48.342614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879631c-872e-44cc-b185-af9b92cc65ec None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:48.351596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 97/204] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:48 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:48.362320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879631c-872e-44cc-b185-af9b92cc65ec None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:48.436243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 108/205] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:48.445562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7aee9-65db-4610-929c-5edb600b562d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:48.472564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879631c-872e-44cc-b185-af9b92cc65ec None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:48.520566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:48.521791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:48.522075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:48.522353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:48.523196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] RBAC: Adding query filter params (role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=f0730edd303b4a70a18988aaf37dbc60, user.id=249af81fd8fd4732b1b447f068587a1b) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:48.523534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:48.524971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:48.538473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 98/206] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:48 2022] GET /identity/v3/role_assignments?user.id=249af81fd8fd4732b1b447f068587a1b&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:48.559546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7aee9-65db-4610-929c-5edb600b562d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:48.596559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c07a55-de6c-41e0-b1ac-048f9a727474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:48.597427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c07a55-de6c-41e0-b1ac-048f9a727474 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:48.597707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c07a55-de6c-41e0-b1ac-048f9a727474 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:48.597979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c07a55-de6c-41e0-b1ac-048f9a727474 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:48.599207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c07a55-de6c-41e0-b1ac-048f9a727474 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:48.600751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c07a55-de6c-41e0-b1ac-048f9a727474 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:48.602919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 109/207] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:48 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:48.608405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:48.748256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b776c4-1e75-44fd-8a49-1aa0faf14752 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:48.790617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74501c64-6cb9-44b7-9daa-a62a94316710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:48.791283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501c64-6cb9-44b7-9daa-a62a94316710 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:48.791586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501c64-6cb9-44b7-9daa-a62a94316710 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:48.791862 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501c64-6cb9-44b7-9daa-a62a94316710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:48.792701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74501c64-6cb9-44b7-9daa-a62a94316710 None admin] RBAC: Adding query filter params (role.id=0bf71370710241c1a66971b7dc2b2b6a, scope.project.id=fd89398693a247abb18b91b7cd6b5840, user.id=66943d3bd09b43909b116b79699ce70d) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:48.793014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74501c64-6cb9-44b7-9daa-a62a94316710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:48.794452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74501c64-6cb9-44b7-9daa-a62a94316710 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:48.800906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 99/208] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:48 2022] GET /identity/v3/role_assignments?user.id=66943d3bd09b43909b116b79699ce70d&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=0bf71370710241c1a66971b7dc2b2b6a => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:49.510013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd634c3-35ac-4a1f-b6af-f7e010ece037 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:49.510684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd634c3-35ac-4a1f-b6af-f7e010ece037 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:49.510684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd634c3-35ac-4a1f-b6af-f7e010ece037 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:49.512117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 110/209] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:49.517813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c3040-8e06-4e06-b505-606974bb8e20 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:49.518428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c3040-8e06-4e06-b505-606974bb8e20 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:49.518428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c3040-8e06-4e06-b505-606974bb8e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:49.536961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-515c3040-8e06-4e06-b505-606974bb8e20 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:49.538169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-515c3040-8e06-4e06-b505-606974bb8e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:49.606377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 100/210] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:49.631245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd634c3-35ac-4a1f-b6af-f7e010ece037 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:49.703865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4310a6-6f07-4d8b-ac35-1b9e16d939d6 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:49.703865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4310a6-6f07-4d8b-ac35-1b9e16d939d6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:49.703865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4310a6-6f07-4d8b-ac35-1b9e16d939d6 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:49.706528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 101/211] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:49.714136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9e61-b8be-4ac2-b8e5-7ee1b1d4548a None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:49.714136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9e61-b8be-4ac2-b8e5-7ee1b1d4548a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:49.714136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9e61-b8be-4ac2-b8e5-7ee1b1d4548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:49.729853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-3b3f9e61-b8be-4ac2-b8e5-7ee1b1d4548a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:49.731032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3b3f9e61-b8be-4ac2-b8e5-7ee1b1d4548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:49.740871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd634c3-35ac-4a1f-b6af-f7e010ece037 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:49.775071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae78f-6c0a-4dd3-a814-a265b7bcfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:49.776199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae78f-6c0a-4dd3-a814-a265b7bcfa26 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:49.776699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae78f-6c0a-4dd3-a814-a265b7bcfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:49.777164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae78f-6c0a-4dd3-a814-a265b7bcfa26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:49.778535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae78f-6c0a-4dd3-a814-a265b7bcfa26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:49.780223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae78f-6c0a-4dd3-a814-a265b7bcfa26 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:49.782366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 111/212] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:49.788194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae78f-6c0a-4dd3-a814-a265b7bcfa26 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:49.810121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 102/213] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:49.834023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f9e61-b8be-4ac2-b8e5-7ee1b1d4548a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:49.913740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae78f-6c0a-4dd3-a814-a265b7bcfa26 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:49.943996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f9e61-b8be-4ac2-b8e5-7ee1b1d4548a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:49.955865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e090a-902f-4fcf-9554-365c21826499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:49.957143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e090a-902f-4fcf-9554-365c21826499 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:49.957856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e090a-902f-4fcf-9554-365c21826499 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:49.958285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e090a-902f-4fcf-9554-365c21826499 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:49.959578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e090a-902f-4fcf-9554-365c21826499 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:49.961764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e090a-902f-4fcf-9554-365c21826499 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:49.984088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f803af-a07b-4e85-94b8-afdb58b29c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:49.985078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f803af-a07b-4e85-94b8-afdb58b29c7d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:49.985444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f803af-a07b-4e85-94b8-afdb58b29c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:49.985827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f803af-a07b-4e85-94b8-afdb58b29c7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:49.989337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 112/214] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:43:49 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:50.001763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f803af-a07b-4e85-94b8-afdb58b29c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d7f803af-a07b-4e85-94b8-afdb58b29c7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:50.011051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:50.012019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:50.012784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 103/215] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:50.018409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e090a-902f-4fcf-9554-365c21826499 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:50.131599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e090a-902f-4fcf-9554-365c21826499 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:50.168471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:50.169159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:50.169440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:50.169713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:50.170474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:50.170780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:50.172279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:50.182657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 113/216] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:50.188510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f803af-a07b-4e85-94b8-afdb58b29c7d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:50.304158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f803af-a07b-4e85-94b8-afdb58b29c7d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:50.338998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd223cec-daef-467b-b4e9-1e6eb0296cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:50.339909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd223cec-daef-467b-b4e9-1e6eb0296cd7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:50.340190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd223cec-daef-467b-b4e9-1e6eb0296cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:50.340462 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd223cec-daef-467b-b4e9-1e6eb0296cd7 None admin] PATH_INFO: `/v3/users/00596a62eed8455dbbd53c4109948356` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:50.354082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd223cec-daef-467b-b4e9-1e6eb0296cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=00596a62eed8455dbbd53c4109948356)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:50.355598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd223cec-daef-467b-b4e9-1e6eb0296cd7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:50.357616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 104/217] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:50 2022] GET /identity/v3/users/00596a62eed8455dbbd53c4109948356 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:50.362885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:50.425620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084f7c-7ee7-46f8-96dd-4262ae9363d3 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:50.425944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084f7c-7ee7-46f8-96dd-4262ae9363d3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:50.426184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084f7c-7ee7-46f8-96dd-4262ae9363d3 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:50.428376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 105/218] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:50.434788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9fc77-50d1-4448-ae8f-36c4c9370b0f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:50.435319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9fc77-50d1-4448-ae8f-36c4c9370b0f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:50.435622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9fc77-50d1-4448-ae8f-36c4c9370b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:50.454573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c4b9fc77-50d1-4448-ae8f-36c4c9370b0f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:50.455816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c4b9fc77-50d1-4448-ae8f-36c4c9370b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:50.481729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc6d83-8991-491f-9dc9-e1cf16513226 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:50.520297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a1111-79db-4138-bad3-bc905ebbdffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:50.521105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a1111-79db-4138-bad3-bc905ebbdffe None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:50.521274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a1111-79db-4138-bad3-bc905ebbdffe None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:50.521539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a1111-79db-4138-bad3-bc905ebbdffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:50.542032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 106/219] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:50.565177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9fc77-50d1-4448-ae8f-36c4c9370b0f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:50.601923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a1111-79db-4138-bad3-bc905ebbdffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:50.604243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a1111-79db-4138-bad3-bc905ebbdffe None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:50.676615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9fc77-50d1-4448-ae8f-36c4c9370b0f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:50.715824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b206d8b-91df-43c4-b996-2073fad0df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:50.717010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206d8b-91df-43c4-b996-2073fad0df3b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:50.717498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206d8b-91df-43c4-b996-2073fad0df3b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:50.717966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206d8b-91df-43c4-b996-2073fad0df3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:50.718069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 114/220] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 18:43:50.724209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a1111-79db-4138-bad3-bc905ebbdffe None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:50.731432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b206d8b-91df-43c4-b996-2073fad0df3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-9b206d8b-91df-43c4-b996-2073fad0df3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:50.739593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:50.740519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:50.741281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:50.744459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 107/221] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:43:50.750304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b206d8b-91df-43c4-b996-2073fad0df3b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:50.910714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a1111-79db-4138-bad3-bc905ebbdffe None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:50.935817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b206d8b-91df-43c4-b996-2073fad0df3b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:50.963744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6e47e-077c-4533-84af-592b7401e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:50.964604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e47e-077c-4533-84af-592b7401e6d6 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:50.964875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e47e-077c-4533-84af-592b7401e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:50.965141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e47e-077c-4533-84af-592b7401e6d6 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:50.967014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6e47e-077c-4533-84af-592b7401e6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:50.968493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6e47e-077c-4533-84af-592b7401e6d6 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:50.970334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 115/222] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:50 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:50.976970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6e47e-077c-4533-84af-592b7401e6d6 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:51.007376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:51.008044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.008372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.008641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.009880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:51.010206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:51.011586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:51.026224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 108/223] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:51.033743 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:51.126331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6e47e-077c-4533-84af-592b7401e6d6 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:51.141051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050083a2-7e31-4242-9c3d-e2c0fb06b81b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:51.176214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2787c-efce-48f2-bfb2-9867970955d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:51.178012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2787c-efce-48f2-bfb2-9867970955d2 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.178291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2787c-efce-48f2-bfb2-9867970955d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.178557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2787c-efce-48f2-bfb2-9867970955d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.179408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2787c-efce-48f2-bfb2-9867970955d2 None admin] RBAC: Adding query filter params (role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=f0730edd303b4a70a18988aaf37dbc60, user.id=00596a62eed8455dbbd53c4109948356) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:51.179715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2787c-efce-48f2-bfb2-9867970955d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:51.181156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2787c-efce-48f2-bfb2-9867970955d2 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:51.182416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261e3aa-5cce-4003-ae4e-9d058199f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:51.183822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261e3aa-5cce-4003-ae4e-9d058199f025 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.184724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261e3aa-5cce-4003-ae4e-9d058199f025 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.185448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261e3aa-5cce-4003-ae4e-9d058199f025 None admin] PATH_INFO: `/v3/users/249af81fd8fd4732b1b447f068587a1b` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.186936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261e3aa-5cce-4003-ae4e-9d058199f025 None admin] RBAC: Authorizing `identity:get_user(user_id=249af81fd8fd4732b1b447f068587a1b)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:51.188597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261e3aa-5cce-4003-ae4e-9d058199f025 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:51.195619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 116/224] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:50 2022] GET /identity/v3/role_assignments?user.id=00596a62eed8455dbbd53c4109948356&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=39757d16971a48b6836913cd1908f48e => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:51.196090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 109/225] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:51 2022] GET /identity/v3/users/249af81fd8fd4732b1b447f068587a1b => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:51.197244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261e3aa-5cce-4003-ae4e-9d058199f025 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:51.202070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0ec9e-3972-4dd0-b1cc-94ad5d2652f8 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.202355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0ec9e-3972-4dd0-b1cc-94ad5d2652f8 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.202631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0ec9e-3972-4dd0-b1cc-94ad5d2652f8 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.209181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 117/226] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:51.215675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3512d6-26fa-4b77-9982-989e19a073c0 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.215954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3512d6-26fa-4b77-9982-989e19a073c0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.216225 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3512d6-26fa-4b77-9982-989e19a073c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.252405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-ab3512d6-26fa-4b77-9982-989e19a073c0 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:51.253881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ab3512d6-26fa-4b77-9982-989e19a073c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:51.339821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261e3aa-5cce-4003-ae4e-9d058199f025 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:51.391452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 118/227] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:51.396928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa083d-15b8-451e-a087-2093618db23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:51.397790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa083d-15b8-451e-a087-2093618db23c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.398064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa083d-15b8-451e-a087-2093618db23c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.398387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa083d-15b8-451e-a087-2093618db23c None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.399728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa083d-15b8-451e-a087-2093618db23c None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:51.401527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa083d-15b8-451e-a087-2093618db23c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:51.403422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 110/228] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:51 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:51.409483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3512d6-26fa-4b77-9982-989e19a073c0 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:51.430790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa083d-15b8-451e-a087-2093618db23c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:51.546676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3512d6-26fa-4b77-9982-989e19a073c0 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:51.554485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa083d-15b8-451e-a087-2093618db23c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:51.590628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbc779-cee0-4150-8acf-6110bbb07c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:51.591810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbc779-cee0-4150-8acf-6110bbb07c14 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.592347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbc779-cee0-4150-8acf-6110bbb07c14 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.592838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbc779-cee0-4150-8acf-6110bbb07c14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.603699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbc779-cee0-4150-8acf-6110bbb07c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-4bdbc779-cee0-4150-8acf-6110bbb07c14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:51.612825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:51.613688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:51.614487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:51.617527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03d507-9558-4892-beea-167eddcd4314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:51.617783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 111/229] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:43:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:43:51.622865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03d507-9558-4892-beea-167eddcd4314 None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.622865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03d507-9558-4892-beea-167eddcd4314 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.622865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03d507-9558-4892-beea-167eddcd4314 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60/users/249af81fd8fd4732b1b447f068587a1b/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.624363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbc779-cee0-4150-8acf-6110bbb07c14 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:51.624644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03d507-9558-4892-beea-167eddcd4314 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0730edd303b4a70a18988aaf37dbc60, user_id=249af81fd8fd4732b1b447f068587a1b, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:51.626118 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03d507-9558-4892-beea-167eddcd4314 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:51.657839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 119/230] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:51 2022] PUT /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60/users/249af81fd8fd4732b1b447f068587a1b/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:51.740641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbc779-cee0-4150-8acf-6110bbb07c14 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:51.779048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:51.780174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.780677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.781156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.782149 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:51.782659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:51.784357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:51.794423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 112/231] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:43:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:51.800672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03d507-9558-4892-beea-167eddcd4314 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:51.932047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03d507-9558-4892-beea-167eddcd4314 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:51.967203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66e61-e04d-4d37-a50d-9663aafbcce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:51.968116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66e61-e04d-4d37-a50d-9663aafbcce3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:51.968395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66e61-e04d-4d37-a50d-9663aafbcce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:51.968668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66e61-e04d-4d37-a50d-9663aafbcce3 None admin] PATH_INFO: `/v3/users/249af81fd8fd4732b1b447f068587a1b` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:51.969873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66e61-e04d-4d37-a50d-9663aafbcce3 None admin] RBAC: Authorizing `identity:get_user(user_id=249af81fd8fd4732b1b447f068587a1b)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:51.971361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66e61-e04d-4d37-a50d-9663aafbcce3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:51.973065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 120/232] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:51 2022] GET /identity/v3/users/249af81fd8fd4732b1b447f068587a1b => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:51.978810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:52.086884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24dbd9-6738-4222-8cf4-50b5b4225c55 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:52.124979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce1b3a-1415-4ed9-89b2-f73eaf435762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:52.125859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce1b3a-1415-4ed9-89b2-f73eaf435762 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:52.126189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce1b3a-1415-4ed9-89b2-f73eaf435762 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:52.126456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce1b3a-1415-4ed9-89b2-f73eaf435762 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:52.127662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce1b3a-1415-4ed9-89b2-f73eaf435762 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:52.129109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce1b3a-1415-4ed9-89b2-f73eaf435762 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:52.131683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 113/233] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:51 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:52.137266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66e61-e04d-4d37-a50d-9663aafbcce3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:52.270990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66e61-e04d-4d37-a50d-9663aafbcce3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:52.313973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb6c3-c663-402c-a603-62eacf87fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:52.315117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb6c3-c663-402c-a603-62eacf87fc69 None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:52.315422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb6c3-c663-402c-a603-62eacf87fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:52.315696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb6c3-c663-402c-a603-62eacf87fc69 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60/users/249af81fd8fd4732b1b447f068587a1b/roles/b522cd7d0a2e4208bd451e2a39c97d63` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:52.321240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cb6c3-c663-402c-a603-62eacf87fc69 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0730edd303b4a70a18988aaf37dbc60, user_id=249af81fd8fd4732b1b447f068587a1b, role_id=b522cd7d0a2e4208bd451e2a39c97d63)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:52.322718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cb6c3-c663-402c-a603-62eacf87fc69 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:52.341566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 121/234] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:52 2022] PUT /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60/users/249af81fd8fd4732b1b447f068587a1b/roles/b522cd7d0a2e4208bd451e2a39c97d63 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:52.764274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f441c9-cb81-4b49-ab08-9cb0e32b7a40 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:52.765184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f441c9-cb81-4b49-ab08-9cb0e32b7a40 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:52.765683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f441c9-cb81-4b49-ab08-9cb0e32b7a40 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:52.767558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 114/235] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:52.773226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cd08-adc4-42c6-9709-6349d220fe8a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:52.773694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cd08-adc4-42c6-9709-6349d220fe8a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:52.773769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cd08-adc4-42c6-9709-6349d220fe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:52.799567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-4e56cd08-adc4-42c6-9709-6349d220fe8a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:52.800769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4e56cd08-adc4-42c6-9709-6349d220fe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:52.885159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 122/236] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:52.921736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f441c9-cb81-4b49-ab08-9cb0e32b7a40 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:53.068567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f441c9-cb81-4b49-ab08-9cb0e32b7a40 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:53.094897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7c08d-9995-403f-a543-f531eba9e103 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:53.095437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7c08d-9995-403f-a543-f531eba9e103 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:53.095948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7c08d-9995-403f-a543-f531eba9e103 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:53.103037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 123/237] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:53.107558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377dd72-bff2-407a-ae3e-5f57fe611cd2 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:53.108287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377dd72-bff2-407a-ae3e-5f57fe611cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:53.108868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377dd72-bff2-407a-ae3e-5f57fe611cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:53.109281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04780c6-cdbd-4a8f-8c88-2c880aabd4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:53.110074 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04780c6-cdbd-4a8f-8c88-2c880aabd4ee None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:53.110347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04780c6-cdbd-4a8f-8c88-2c880aabd4ee None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:53.110614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04780c6-cdbd-4a8f-8c88-2c880aabd4ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:53.130110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5377dd72-bff2-407a-ae3e-5f57fe611cd2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:53.131692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5377dd72-bff2-407a-ae3e-5f57fe611cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:53.133261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04780c6-cdbd-4a8f-8c88-2c880aabd4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-b04780c6-cdbd-4a8f-8c88-2c880aabd4ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:53.142424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:53.143277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:53.144079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:53.154486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 115/238] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:53.163082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04780c6-cdbd-4a8f-8c88-2c880aabd4ee None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:53.261316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 124/239] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:53.294445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377dd72-bff2-407a-ae3e-5f57fe611cd2 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:53.330400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04780c6-cdbd-4a8f-8c88-2c880aabd4ee None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:53.389603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:53.390777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:53.391259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:53.391857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:53.392812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:53.393315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:53.394941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:53.404658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 116/240] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:53.410263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:53.486938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377dd72-bff2-407a-ae3e-5f57fe611cd2 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:53.512722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839f3b-9abc-49cf-9e1c-58de2c798b20 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:53.530907 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399de29-8027-4c7d-abe0-5aa23ffd778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:53.532020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399de29-8027-4c7d-abe0-5aa23ffd778b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:53.532475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399de29-8027-4c7d-abe0-5aa23ffd778b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:53.532909 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399de29-8027-4c7d-abe0-5aa23ffd778b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:53.534236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399de29-8027-4c7d-abe0-5aa23ffd778b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:53.535938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399de29-8027-4c7d-abe0-5aa23ffd778b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:53.538103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 125/241] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:53.543541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399de29-8027-4c7d-abe0-5aa23ffd778b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:53.548644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a98c6-287b-457a-be43-43ea92fa892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:53.549533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a98c6-287b-457a-be43-43ea92fa892a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:53.549813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a98c6-287b-457a-be43-43ea92fa892a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:53.550084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a98c6-287b-457a-be43-43ea92fa892a None admin] PATH_INFO: `/v3/users/66b169f33ad64a128185dce32ddd4138` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:53.564148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a98c6-287b-457a-be43-43ea92fa892a None admin] RBAC: Authorizing `identity:get_user(user_id=66b169f33ad64a128185dce32ddd4138)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:53.565939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a98c6-287b-457a-be43-43ea92fa892a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:53.568305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 117/242] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:53 2022] GET /identity/v3/users/66b169f33ad64a128185dce32ddd4138 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:53.574373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a98c6-287b-457a-be43-43ea92fa892a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:53.689169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a98c6-287b-457a-be43-43ea92fa892a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:53.697396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399de29-8027-4c7d-abe0-5aa23ffd778b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:53.727556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bfa35-14ce-4b4b-b450-88130f69f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:53.728932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfa35-14ce-4b4b-b450-88130f69f542 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:53.729441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfa35-14ce-4b4b-b450-88130f69f542 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:53.729913 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfa35-14ce-4b4b-b450-88130f69f542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:53.780847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875aba-e2da-44c0-8d25-157f7331c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:53.781515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875aba-e2da-44c0-8d25-157f7331c548 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:53.781952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875aba-e2da-44c0-8d25-157f7331c548 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:53.782445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875aba-e2da-44c0-8d25-157f7331c548 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:53.783286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875aba-e2da-44c0-8d25-157f7331c548 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:53.784950 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875aba-e2da-44c0-8d25-157f7331c548 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:53.808202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bfa35-14ce-4b4b-b450-88130f69f542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:53.808880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bfa35-14ce-4b4b-b450-88130f69f542 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:53.828685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 126/243] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:43:53 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:53.919054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 118/244] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 18:43:53.925065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875aba-e2da-44c0-8d25-157f7331c548 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:54.059602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875aba-e2da-44c0-8d25-157f7331c548 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:54.093725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37987-f414-4fe1-946e-ea46c890ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:54.094608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37987-f414-4fe1-946e-ea46c890ff12 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.094880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37987-f414-4fe1-946e-ea46c890ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.095155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37987-f414-4fe1-946e-ea46c890ff12 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.096392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e37987-f414-4fe1-946e-ea46c890ff12 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:54.097868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e37987-f414-4fe1-946e-ea46c890ff12 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:54.099674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 127/245] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:53 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:54.105629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bfa35-14ce-4b4b-b450-88130f69f542 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:54.184007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44264e4-e6cf-414d-9238-8d17ebf37555 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.184322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44264e4-e6cf-414d-9238-8d17ebf37555 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.184566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44264e4-e6cf-414d-9238-8d17ebf37555 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.186256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 128/246] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:54.191364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b537dc-1da5-4f21-a4b3-3444b428203e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.191653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b537dc-1da5-4f21-a4b3-3444b428203e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.191931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b537dc-1da5-4f21-a4b3-3444b428203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.213571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bfa35-14ce-4b4b-b450-88130f69f542 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:54.218853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b5b537dc-1da5-4f21-a4b3-3444b428203e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:54.220177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b5b537dc-1da5-4f21-a4b3-3444b428203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:54.255144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:54.256742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.257249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.257719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.258755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] RBAC: Adding query filter params (role.id=0bf71370710241c1a66971b7dc2b2b6a, scope.project.id=f0730edd303b4a70a18988aaf37dbc60, user.id=66b169f33ad64a128185dce32ddd4138) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:54.259272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:54.261814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:54.269754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 119/247] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:54 2022] GET /identity/v3/role_assignments?user.id=66b169f33ad64a128185dce32ddd4138&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=0bf71370710241c1a66971b7dc2b2b6a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:54.313736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 129/248] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:54.339053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:54.463873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7b82f-aeb2-4dfe-a645-1bfa5ac09615 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:54.474218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e983a-5f6f-4cd8-9818-36930c34a2b7 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.474875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e983a-5f6f-4cd8-9818-36930c34a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.475385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e983a-5f6f-4cd8-9818-36930c34a2b7 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.477030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 130/249] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:54.482803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b5b2-4807-4d35-b047-3f89d271f834 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.483091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b5b2-4807-4d35-b047-3f89d271f834 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.484533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b5b2-4807-4d35-b047-3f89d271f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.507414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3678b5b2-4807-4d35-b047-3f89d271f834 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:54.509554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3678b5b2-4807-4d35-b047-3f89d271f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:54.521778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9acd85-d00b-4c69-925e-639c7868da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:54.522589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9acd85-d00b-4c69-925e-639c7868da19 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.522869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9acd85-d00b-4c69-925e-639c7868da19 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.523198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9acd85-d00b-4c69-925e-639c7868da19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.538408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9acd85-d00b-4c69-925e-639c7868da19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-5f9acd85-d00b-4c69-925e-639c7868da19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:54.547438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:54.548318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:54.549060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 120/250] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:54.554921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9acd85-d00b-4c69-925e-639c7868da19 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:54.606252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 131/251] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:54.630190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b5b2-4807-4d35-b047-3f89d271f834 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:54.687751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9acd85-d00b-4c69-925e-639c7868da19 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:54.727290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:54.728155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.728778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.729070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.730117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] RBAC: Adding query filter params (name=member) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:54.730423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:54.732286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:54.744352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 121/252] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:54.750821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:54.751099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b5b2-4807-4d35-b047-3f89d271f834 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:54.807671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd362b6-9d90-4101-b131-c8adb3d2e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:54.809550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd362b6-9d90-4101-b131-c8adb3d2e1ac None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:54.810025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd362b6-9d90-4101-b131-c8adb3d2e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:54.810680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd362b6-9d90-4101-b131-c8adb3d2e1ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:54.829546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd362b6-9d90-4101-b131-c8adb3d2e1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-dfd362b6-9d90-4101-b131-c8adb3d2e1ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:54.846359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:54.847284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:43:54.848093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:54.853807 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 132/253] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:54.877270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd362b6-9d90-4101-b131-c8adb3d2e1ac None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:54.958248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c0ba9-3892-44de-95ae-fb2a10ce7988 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:55.018788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a64953-8b7c-432b-a0ed-c161b834165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:55.020081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a64953-8b7c-432b-a0ed-c161b834165e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:55.020556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a64953-8b7c-432b-a0ed-c161b834165e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:55.021564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a64953-8b7c-432b-a0ed-c161b834165e None admin] PATH_INFO: `/v3/users/00596a62eed8455dbbd53c4109948356` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:55.022986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a64953-8b7c-432b-a0ed-c161b834165e None admin] RBAC: Authorizing `identity:get_user(user_id=00596a62eed8455dbbd53c4109948356)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:55.025152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a64953-8b7c-432b-a0ed-c161b834165e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:55.027024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 122/254] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:54 2022] GET /identity/v3/users/00596a62eed8455dbbd53c4109948356 => generated 297 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:55.032449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a64953-8b7c-432b-a0ed-c161b834165e None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:55.064032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd362b6-9d90-4101-b131-c8adb3d2e1ac None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:55.103700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:55.104899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:55.105391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:55.105908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:55.106906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:55.108244 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:55.109853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:55.120197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 133/255] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:55.126052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:55.257510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a64953-8b7c-432b-a0ed-c161b834165e None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:55.311019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28d5da-6ae5-4b07-b226-f38526e3b1f9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:55.331052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86392e8d-ec55-4c25-b32c-e713f3d82a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:55.332358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86392e8d-ec55-4c25-b32c-e713f3d82a88 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:55.332838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86392e8d-ec55-4c25-b32c-e713f3d82a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:55.333299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86392e8d-ec55-4c25-b32c-e713f3d82a88 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:55.334784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86392e8d-ec55-4c25-b32c-e713f3d82a88 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:55.336440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86392e8d-ec55-4c25-b32c-e713f3d82a88 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:55.338643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 123/256] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:55 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:55.343845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86392e8d-ec55-4c25-b32c-e713f3d82a88 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:55.396572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8401-7bf5-4b2a-8180-6554b91201e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:55.397456 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8401-7bf5-4b2a-8180-6554b91201e4 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:55.397736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8401-7bf5-4b2a-8180-6554b91201e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:55.398012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8401-7bf5-4b2a-8180-6554b91201e4 None admin] PATH_INFO: `/v3/users/249af81fd8fd4732b1b447f068587a1b` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:55.404073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8401-7bf5-4b2a-8180-6554b91201e4 None admin] RBAC: Authorizing `identity:get_user(user_id=249af81fd8fd4732b1b447f068587a1b)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:55.405549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8401-7bf5-4b2a-8180-6554b91201e4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:55.407265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 134/257] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:55 2022] GET /identity/v3/users/249af81fd8fd4732b1b447f068587a1b => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:55.418776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8401-7bf5-4b2a-8180-6554b91201e4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:55.523580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86392e8d-ec55-4c25-b32c-e713f3d82a88 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:55.545436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8401-7bf5-4b2a-8180-6554b91201e4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:55.578955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8261cf1-bb7c-4ec8-bf31-dfbe11de3258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:55.580254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8261cf1-bb7c-4ec8-bf31-dfbe11de3258 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:55.584379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8261cf1-bb7c-4ec8-bf31-dfbe11de3258 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:55.584865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8261cf1-bb7c-4ec8-bf31-dfbe11de3258 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60/users/00596a62eed8455dbbd53c4109948356/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:55.587082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8261cf1-bb7c-4ec8-bf31-dfbe11de3258 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0730edd303b4a70a18988aaf37dbc60, user_id=00596a62eed8455dbbd53c4109948356, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:55.589977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8261cf1-bb7c-4ec8-bf31-dfbe11de3258 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:55.613923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 124/258] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:55 2022] PUT /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60/users/00596a62eed8455dbbd53c4109948356/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:43:55.615541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657628-4bf9-4368-9dad-f5bd38c1e384 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:55.616113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9f22a-917b-423b-86c8-9fb6e364b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:55.616611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657628-4bf9-4368-9dad-f5bd38c1e384 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:55.617482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f22a-917b-423b-86c8-9fb6e364b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:55.617968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657628-4bf9-4368-9dad-f5bd38c1e384 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:55.619594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 125/259] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:55.620123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f22a-917b-423b-86c8-9fb6e364b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:55.620590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f22a-917b-423b-86c8-9fb6e364b5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:55.625180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a8d5d-ff1d-4b5e-8845-b90b5b0ae7c4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:55.625705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a8d5d-ff1d-4b5e-8845-b90b5b0ae7c4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:55.626185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a8d5d-ff1d-4b5e-8845-b90b5b0ae7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:55.654556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-010a8d5d-ff1d-4b5e-8845-b90b5b0ae7c4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:55.656320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-010a8d5d-ff1d-4b5e-8845-b90b5b0ae7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:55.758299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 126/260] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:55.761145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9f22a-917b-423b-86c8-9fb6e364b5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:55.762639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9f22a-917b-423b-86c8-9fb6e364b5b7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:55.796375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a8d5d-ff1d-4b5e-8845-b90b5b0ae7c4 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:55.944018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 135/261] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 18:43:55.952438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9f22a-917b-423b-86c8-9fb6e364b5b7 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:55.997889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a8d5d-ff1d-4b5e-8845-b90b5b0ae7c4 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:56.038903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778574-1aac-43d2-b8d5-f9745210e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:56.039894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778574-1aac-43d2-b8d5-f9745210e250 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:56.040181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778574-1aac-43d2-b8d5-f9745210e250 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:56.040456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778574-1aac-43d2-b8d5-f9745210e250 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:56.056453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96778574-1aac-43d2-b8d5-f9745210e250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-96778574-1aac-43d2-b8d5-f9745210e250 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:56.066967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:56.068426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:43:56.069175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:56.069754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 127/262] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:43:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:43:56.075435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778574-1aac-43d2-b8d5-f9745210e250 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:56.092390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9f22a-917b-423b-86c8-9fb6e364b5b7 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:56.155782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc722-cb94-48ff-8c0d-c8d45c69d74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:56.156683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc722-cb94-48ff-8c0d-c8d45c69d74c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:56.156960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc722-cb94-48ff-8c0d-c8d45c69d74c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:56.157232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc722-cb94-48ff-8c0d-c8d45c69d74c None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:56.159836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fc722-cb94-48ff-8c0d-c8d45c69d74c None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:56.161320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fc722-cb94-48ff-8c0d-c8d45c69d74c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:56.168008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 136/263] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:55 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:56.169707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc722-cb94-48ff-8c0d-c8d45c69d74c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:56.269482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778574-1aac-43d2-b8d5-f9745210e250 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:56.350923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:56.351597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:56.351879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:56.352153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:56.352919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:56.353222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:56.354602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:56.363119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 128/264] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:43:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:56.369773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:56.386930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc722-cb94-48ff-8c0d-c8d45c69d74c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:56.488004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:56.488673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:56.488957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:56.489233 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:56.490599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=f0730edd303b4a70a18988aaf37dbc60, user.id=249af81fd8fd4732b1b447f068587a1b) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:56.490909 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:56.492393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:56.501696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb827-3a70-4bbb-aac3-6d19ad5a6265 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:56.509501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 137/265] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:56 2022] GET /identity/v3/role_assignments?user.id=249af81fd8fd4732b1b447f068587a1b&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:56.537933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b88e1-72bf-4dbe-a173-4e385a9237bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:56.538823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b88e1-72bf-4dbe-a173-4e385a9237bb None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:56.539151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b88e1-72bf-4dbe-a173-4e385a9237bb None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:56.539457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b88e1-72bf-4dbe-a173-4e385a9237bb None admin] PATH_INFO: `/v3/users/249af81fd8fd4732b1b447f068587a1b` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:56.540682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b88e1-72bf-4dbe-a173-4e385a9237bb None admin] RBAC: Authorizing `identity:get_user(user_id=249af81fd8fd4732b1b447f068587a1b)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:56.542128 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b88e1-72bf-4dbe-a173-4e385a9237bb None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:56.544000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 129/266] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:56 2022] GET /identity/v3/users/249af81fd8fd4732b1b447f068587a1b => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:56.549375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:56.716377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62531b-6537-4ecd-85b3-43fbd9deb427 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:56.761461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1bfc4-2d28-4de6-a0ba-f2f7719efee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:56.762115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1bfc4-2d28-4de6-a0ba-f2f7719efee1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:56.762391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1bfc4-2d28-4de6-a0ba-f2f7719efee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:56.762660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1bfc4-2d28-4de6-a0ba-f2f7719efee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:56.858822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1bfc4-2d28-4de6-a0ba-f2f7719efee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:56.860340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1bfc4-2d28-4de6-a0ba-f2f7719efee1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:56.994307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 138/267] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:43:57.000612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b88e1-72bf-4dbe-a173-4e385a9237bb None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:57.161653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b88e1-72bf-4dbe-a173-4e385a9237bb None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:57.204998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d714da-63f7-46ae-9746-23e3ddd688c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:57.206243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d714da-63f7-46ae-9746-23e3ddd688c1 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.206713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d714da-63f7-46ae-9746-23e3ddd688c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.207174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d714da-63f7-46ae-9746-23e3ddd688c1 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.209198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d714da-63f7-46ae-9746-23e3ddd688c1 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:57.212056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d714da-63f7-46ae-9746-23e3ddd688c1 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:57.212640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 130/268] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:56 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:57.218456 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1bfc4-2d28-4de6-a0ba-f2f7719efee1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:57.309257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace576fd-b53d-4e5d-a063-8947cf538013 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.309424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace576fd-b53d-4e5d-a063-8947cf538013 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.309699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace576fd-b53d-4e5d-a063-8947cf538013 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.312737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 131/269] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:57.318872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c538a9-5a15-42de-8510-0ad5c7b4d0a6 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.319153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c538a9-5a15-42de-8510-0ad5c7b4d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.319482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c538a9-5a15-42de-8510-0ad5c7b4d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.343138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-e2c538a9-5a15-42de-8510-0ad5c7b4d0a6 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:57.344332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e2c538a9-5a15-42de-8510-0ad5c7b4d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:57.372106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1bfc4-2d28-4de6-a0ba-f2f7719efee1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:57.432843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:57.433539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.433816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.434084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.434918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] RBAC: Adding query filter params (role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=f0730edd303b4a70a18988aaf37dbc60, user.id=249af81fd8fd4732b1b447f068587a1b) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:57.435223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:57.436687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:57.448214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 139/270] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:57 2022] GET /identity/v3/role_assignments?user.id=249af81fd8fd4732b1b447f068587a1b&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:57.465948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 132/271] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:57.501611 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:57.643336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd9a2-b911-4250-8243-b137499cc265 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:57.690736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cc116-d1d4-4fcc-a2aa-2fcf343a23c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:57.691581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc116-d1d4-4fcc-a2aa-2fcf343a23c2 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.691858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc116-d1d4-4fcc-a2aa-2fcf343a23c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.692129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc116-d1d4-4fcc-a2aa-2fcf343a23c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.703963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cc116-d1d4-4fcc-a2aa-2fcf343a23c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-454cc116-d1d4-4fcc-a2aa-2fcf343a23c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:57.712302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:57.713160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:43:57.713930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 140/272] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:57.719175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c538a9-5a15-42de-8510-0ad5c7b4d0a6 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:57.777699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd38c-f84b-4a0a-ad68-4aa99b6d3597 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.777980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd38c-f84b-4a0a-ad68-4aa99b6d3597 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.778262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd38c-f84b-4a0a-ad68-4aa99b6d3597 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.779888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 141/273] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:43:57.785153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812e809-4127-4d25-9fd9-126e2b926111 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.785435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812e809-4127-4d25-9fd9-126e2b926111 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.785704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812e809-4127-4d25-9fd9-126e2b926111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.807507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7812e809-4127-4d25-9fd9-126e2b926111 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:57.809235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7812e809-4127-4d25-9fd9-126e2b926111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:57.847438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c538a9-5a15-42de-8510-0ad5c7b4d0a6 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:57.891759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:57.892432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.892710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.892984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.895548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:57.895548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:57.895548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:57.899842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 142/274] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:57.901193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55913-8a88-4c27-a41f-5c8b8ceaeb47 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.901475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55913-8a88-4c27-a41f-5c8b8ceaeb47 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.901744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55913-8a88-4c27-a41f-5c8b8ceaeb47 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.903159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 143/275] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:57.906408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 133/276] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:57.908502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf9e5-179a-485c-a1d3-196cfff43af8 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:57.908788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf9e5-179a-485c-a1d3-196cfff43af8 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:57.909064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf9e5-179a-485c-a1d3-196cfff43af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:57.912052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:57.926890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-347cf9e5-179a-485c-a1d3-196cfff43af8 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:57.928641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-347cf9e5-179a-485c-a1d3-196cfff43af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:58.002555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 144/277] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:43:58.003286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cf9e5-179a-485c-a1d3-196cfff43af8 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.021076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18ec0-7b95-4dc0-8975-55f177610696 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.061551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d1aa-45ba-43ca-b13d-a7ff973a46b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.063073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d1aa-45ba-43ca-b13d-a7ff973a46b7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.063598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d1aa-45ba-43ca-b13d-a7ff973a46b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.064100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d1aa-45ba-43ca-b13d-a7ff973a46b7 None admin] PATH_INFO: `/v3/users/66b169f33ad64a128185dce32ddd4138` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.065624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1d1aa-45ba-43ca-b13d-a7ff973a46b7 None admin] RBAC: Authorizing `identity:get_user(user_id=66b169f33ad64a128185dce32ddd4138)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:58.067189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1d1aa-45ba-43ca-b13d-a7ff973a46b7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:58.073702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 134/278] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:57 2022] GET /identity/v3/users/66b169f33ad64a128185dce32ddd4138 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:58.073702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d1aa-45ba-43ca-b13d-a7ff973a46b7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.110597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cf9e5-179a-485c-a1d3-196cfff43af8 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.143379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cece21-654a-40ad-a5d9-0595952dba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.144169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cece21-654a-40ad-a5d9-0595952dba64 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.144446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cece21-654a-40ad-a5d9-0595952dba64 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.144719 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cece21-654a-40ad-a5d9-0595952dba64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.146476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cece21-654a-40ad-a5d9-0595952dba64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:58.147911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cece21-654a-40ad-a5d9-0595952dba64 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:58.149512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 145/279] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:43:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:58.152164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cece21-654a-40ad-a5d9-0595952dba64 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.178758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d1aa-45ba-43ca-b13d-a7ff973a46b7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.217906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f1e4d-5fbd-463c-9e50-cad861c1c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.218701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f1e4d-5fbd-463c-9e50-cad861c1c349 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.218985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f1e4d-5fbd-463c-9e50-cad861c1c349 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.219259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f1e4d-5fbd-463c-9e50-cad861c1c349 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.229305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f1e4d-5fbd-463c-9e50-cad861c1c349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-ab2f1e4d-5fbd-463c-9e50-cad861c1c349 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:58.237049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:58.238066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 135/280] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:43:58.240016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f1e4d-5fbd-463c-9e50-cad861c1c349 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.262993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cece21-654a-40ad-a5d9-0595952dba64 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.296009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57bf8-1b52-4020-beda-3e4cb5b6fee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.296880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57bf8-1b52-4020-beda-3e4cb5b6fee5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.297154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57bf8-1b52-4020-beda-3e4cb5b6fee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.297423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57bf8-1b52-4020-beda-3e4cb5b6fee5 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.298582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57bf8-1b52-4020-beda-3e4cb5b6fee5 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:58.300063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57bf8-1b52-4020-beda-3e4cb5b6fee5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:58.301930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 146/281] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:58 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:58.302533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57bf8-1b52-4020-beda-3e4cb5b6fee5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.345256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f1e4d-5fbd-463c-9e50-cad861c1c349 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.377028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6de1-77f8-4c79-adf5-c9c3b1ba450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.377707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6de1-77f8-4c79-adf5-c9c3b1ba450a None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.377981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6de1-77f8-4c79-adf5-c9c3b1ba450a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.378252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6de1-77f8-4c79-adf5-c9c3b1ba450a None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.378975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b6de1-77f8-4c79-adf5-c9c3b1ba450a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:58.381045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b6de1-77f8-4c79-adf5-c9c3b1ba450a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:58.403324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 136/282] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:43:58 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:43:58.404177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6de1-77f8-4c79-adf5-c9c3b1ba450a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.425243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57bf8-1b52-4020-beda-3e4cb5b6fee5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.475718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.477058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.477535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.478021 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.479180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:58.479714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:58.482228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:58.494433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 147/283] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:58.499666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.522479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6de1-77f8-4c79-adf5-c9c3b1ba450a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.568078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948eedcd-a7a2-4cdc-a756-d0ffc3df641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.569187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eedcd-a7a2-4cdc-a756-d0ffc3df641c None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.569539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eedcd-a7a2-4cdc-a756-d0ffc3df641c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.569891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eedcd-a7a2-4cdc-a756-d0ffc3df641c None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60/users/66b169f33ad64a128185dce32ddd4138/roles/0bf71370710241c1a66971b7dc2b2b6a` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.573059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948eedcd-a7a2-4cdc-a756-d0ffc3df641c None admin] RBAC: Authorizing `identity:create_grant(project_id=f0730edd303b4a70a18988aaf37dbc60, user_id=66b169f33ad64a128185dce32ddd4138, role_id=0bf71370710241c1a66971b7dc2b2b6a)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:58.574916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948eedcd-a7a2-4cdc-a756-d0ffc3df641c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:58.592894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 137/284] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:43:58 2022] PUT /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60/users/66b169f33ad64a128185dce32ddd4138/roles/0bf71370710241c1a66971b7dc2b2b6a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:43:58.594334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe60b7-fd03-4214-a23d-11804a4e701b None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.594618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe60b7-fd03-4214-a23d-11804a4e701b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.594890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe60b7-fd03-4214-a23d-11804a4e701b None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.596279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 138/285] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:43:58.606338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7cf4-797c-4339-a61e-9b94b0f25d2a None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.606939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7cf4-797c-4339-a61e-9b94b0f25d2a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.606939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7cf4-797c-4339-a61e-9b94b0f25d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.627105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a30a7cf4-797c-4339-a61e-9b94b0f25d2a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:43:58.628423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a30a7cf4-797c-4339-a61e-9b94b0f25d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:43:58.636916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd9ac-b349-43d8-adcf-583075c47fc9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.685309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c44310-3197-4426-8df3-d914fff1dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.686336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44310-3197-4426-8df3-d914fff1dc75 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.686604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44310-3197-4426-8df3-d914fff1dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.686883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44310-3197-4426-8df3-d914fff1dc75 None admin] PATH_INFO: `/v3/users/c4531bdb47f54e97ae2f2aedb1e54132` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.708860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c44310-3197-4426-8df3-d914fff1dc75 None admin] RBAC: Authorizing `identity:get_user(user_id=c4531bdb47f54e97ae2f2aedb1e54132)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:58.710553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c44310-3197-4426-8df3-d914fff1dc75 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:58.715447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 148/287] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:58 2022] GET /identity/v3/users/c4531bdb47f54e97ae2f2aedb1e54132 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:58.716010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 139/287] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:43:58.718940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c44310-3197-4426-8df3-d914fff1dc75 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.735998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7cf4-797c-4339-a61e-9b94b0f25d2a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:58.842046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c44310-3197-4426-8df3-d914fff1dc75 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.863036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7cf4-797c-4339-a61e-9b94b0f25d2a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:58.883082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.884117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.884594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.885084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.886124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] RBAC: Adding query filter params (role.id=39757d16971a48b6836913cd1908f48e, user.id=c4531bdb47f54e97ae2f2aedb1e54132, scope.system=all) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:58.886631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:58.888360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:58.894417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 149/288] 10.222.0.93 () {56 vars in 1308 bytes} [Wed May 11 18:43:58 2022] GET /identity/v3/role_assignments?user.id=c4531bdb47f54e97ae2f2aedb1e54132&scope.system=all&role.id=39757d16971a48b6836913cd1908f48e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:58.906801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f176-f256-41c1-a933-525b3c9182e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:58.908051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f176-f256-41c1-a933-525b3c9182e9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:58.908535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f176-f256-41c1-a933-525b3c9182e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:58.908999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f176-f256-41c1-a933-525b3c9182e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:58.927233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678f176-f256-41c1-a933-525b3c9182e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-2678f176-f256-41c1-a933-525b3c9182e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:43:58.937987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:43:58.938874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:43:58.939713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:43:58.941423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 140/289] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:43:58.947507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:59.069701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f84865-85a2-43c0-beea-b064a03ba898 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:59.107599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:59.108631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:59.108917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:59.109193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:59.109947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:43:59.110260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:59.111702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:59.121274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 150/290] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:43:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:59.126270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f176-f256-41c1-a933-525b3c9182e9 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:59.247652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f176-f256-41c1-a933-525b3c9182e9 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:59.297082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036e97-8f4d-46b9-84ae-171d98f3c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:59.298252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036e97-8f4d-46b9-84ae-171d98f3c292 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:59.298731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036e97-8f4d-46b9-84ae-171d98f3c292 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:59.299181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036e97-8f4d-46b9-84ae-171d98f3c292 None admin] PATH_INFO: `/v3/users/00596a62eed8455dbbd53c4109948356` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:59.300602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b036e97-8f4d-46b9-84ae-171d98f3c292 None admin] RBAC: Authorizing `identity:get_user(user_id=00596a62eed8455dbbd53c4109948356)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:59.302746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b036e97-8f4d-46b9-84ae-171d98f3c292 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:59.304959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 141/291] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:43:59 2022] GET /identity/v3/users/00596a62eed8455dbbd53c4109948356 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:43:59.310024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:59.450873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe81d-10a8-44fc-a583-e5d125b7ac44 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:59.484301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2fb21-f1c1-45e3-817f-29ac89fd6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:59.484865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fb21-f1c1-45e3-817f-29ac89fd6eac None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:59.485206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fb21-f1c1-45e3-817f-29ac89fd6eac None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:59.485478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fb21-f1c1-45e3-817f-29ac89fd6eac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:59.550552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2fb21-f1c1-45e3-817f-29ac89fd6eac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:59.552099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2fb21-f1c1-45e3-817f-29ac89fd6eac None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:59.667322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 151/292] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 18:43:59.672508 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036e97-8f4d-46b9-84ae-171d98f3c292 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:43:59.834515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036e97-8f4d-46b9-84ae-171d98f3c292 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:43:59.879669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c58e3b-cebe-42aa-9b8e-e5f478e77efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:43:59.881056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c58e3b-cebe-42aa-9b8e-e5f478e77efb None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:43:59.881328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c58e3b-cebe-42aa-9b8e-e5f478e77efb None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:43:59.881597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c58e3b-cebe-42aa-9b8e-e5f478e77efb None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:43:59.888019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c58e3b-cebe-42aa-9b8e-e5f478e77efb None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:43:59.889464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c58e3b-cebe-42aa-9b8e-e5f478e77efb None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:43:59.891502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 142/293] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:43:59 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:43:59.897837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2fb21-f1c1-45e3-817f-29ac89fd6eac None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:00.029393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2fb21-f1c1-45e3-817f-29ac89fd6eac None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:00.080846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ac072-4feb-4a20-b0ee-9b5653f80f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:00.081497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac072-4feb-4a20-b0ee-9b5653f80f9c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:00.081770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac072-4feb-4a20-b0ee-9b5653f80f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:00.082045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac072-4feb-4a20-b0ee-9b5653f80f9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:00.082875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ac072-4feb-4a20-b0ee-9b5653f80f9c None admin] RBAC: Adding query filter params (role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=f0730edd303b4a70a18988aaf37dbc60, user.id=00596a62eed8455dbbd53c4109948356) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:00.083182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ac072-4feb-4a20-b0ee-9b5653f80f9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:00.086185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ac072-4feb-4a20-b0ee-9b5653f80f9c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:00.092730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 152/294] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:43:59 2022] GET /identity/v3/role_assignments?user.id=00596a62eed8455dbbd53c4109948356&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=39757d16971a48b6836913cd1908f48e => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:01.055024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad0b7-79ac-4e35-aa6e-21083a8bb190 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.055596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad0b7-79ac-4e35-aa6e-21083a8bb190 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.055916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad0b7-79ac-4e35-aa6e-21083a8bb190 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.057829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 143/295] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:01.063464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366071c5-baa3-4ac5-b4b2-3e2300ce8bc4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.063969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366071c5-baa3-4ac5-b4b2-3e2300ce8bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.064443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366071c5-baa3-4ac5-b4b2-3e2300ce8bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.081856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-366071c5-baa3-4ac5-b4b2-3e2300ce8bc4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:01.083865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-366071c5-baa3-4ac5-b4b2-3e2300ce8bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:01.155316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 153/296] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:01.179790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad0b7-79ac-4e35-aa6e-21083a8bb190 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:01.289406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad0b7-79ac-4e35-aa6e-21083a8bb190 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:01.323918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330b5c-c629-4f53-9dbf-dd50ba9e8c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:01.324641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330b5c-c629-4f53-9dbf-dd50ba9e8c62 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.324919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330b5c-c629-4f53-9dbf-dd50ba9e8c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.325191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330b5c-c629-4f53-9dbf-dd50ba9e8c62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.336051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9330b5c-c629-4f53-9dbf-dd50ba9e8c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-a9330b5c-c629-4f53-9dbf-dd50ba9e8c62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:01.343797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:01.344680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:44:01.345481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:01.348129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 144/297] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:01.349721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc672-4186-4411-ae47-9f4d9911f906 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.350008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc672-4186-4411-ae47-9f4d9911f906 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.350396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc672-4186-4411-ae47-9f4d9911f906 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.351125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330b5c-c629-4f53-9dbf-dd50ba9e8c62 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:01.351793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 154/298] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:01.356479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771226e9-3574-4c18-8e23-a7e29623ffe4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.356759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771226e9-3574-4c18-8e23-a7e29623ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.357032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771226e9-3574-4c18-8e23-a7e29623ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.373237 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-771226e9-3574-4c18-8e23-a7e29623ffe4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:01.374409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-771226e9-3574-4c18-8e23-a7e29623ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:01.449493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 155/299] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:01.451272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500a4fa-53de-4a3a-9ebd-756dc47e432f None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.451701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500a4fa-53de-4a3a-9ebd-756dc47e432f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.452052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500a4fa-53de-4a3a-9ebd-756dc47e432f None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.453612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 156/300] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:01.459158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dcc7e-b503-4931-bf5a-79edad51db41 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.459560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dcc7e-b503-4931-bf5a-79edad51db41 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.459914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dcc7e-b503-4931-bf5a-79edad51db41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.463456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330b5c-c629-4f53-9dbf-dd50ba9e8c62 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:01.476568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5b4dcc7e-b503-4931-bf5a-79edad51db41 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:01.478034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5b4dcc7e-b503-4931-bf5a-79edad51db41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:01.500150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:01.500813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.501096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.501375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.502121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:01.502427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:01.503976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:01.516660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 145/301] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:01.516660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:01.559932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 157/302] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:01.560874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dcc7e-b503-4931-bf5a-79edad51db41 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:01.629216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49dc3f-f6db-41d5-9a14-e893b7af7f53 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:01.662839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bfbc5-203a-4bf0-b7d6-ccd2635563c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:01.663659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bfbc5-203a-4bf0-b7d6-ccd2635563c3 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.663935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bfbc5-203a-4bf0-b7d6-ccd2635563c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.664180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dcc7e-b503-4931-bf5a-79edad51db41 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:01.664314 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bfbc5-203a-4bf0-b7d6-ccd2635563c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.674496 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bfbc5-203a-4bf0-b7d6-ccd2635563c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-8b3bfbc5-203a-4bf0-b7d6-ccd2635563c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:01.682251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:01.683254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:01.684299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 146/303] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:01.685123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bfbc5-203a-4bf0-b7d6-ccd2635563c3 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:01.701503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe488bb3-9c62-43f6-9868-953d4d157b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:01.702837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe488bb3-9c62-43f6-9868-953d4d157b83 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.703117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe488bb3-9c62-43f6-9868-953d4d157b83 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.703420 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe488bb3-9c62-43f6-9868-953d4d157b83 None admin] PATH_INFO: `/v3/users/da2647a83bb7457eb4ef7f16b9e98965` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.717042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe488bb3-9c62-43f6-9868-953d4d157b83 None admin] RBAC: Authorizing `identity:get_user(user_id=da2647a83bb7457eb4ef7f16b9e98965)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:01.718640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe488bb3-9c62-43f6-9868-953d4d157b83 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:01.720297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 158/304] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:44:01 2022] GET /identity/v3/users/da2647a83bb7457eb4ef7f16b9e98965 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:01.720297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd68d9e-5cf2-4cca-a3dd-19ba59d7a0cb None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.720297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd68d9e-5cf2-4cca-a3dd-19ba59d7a0cb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.720297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd68d9e-5cf2-4cca-a3dd-19ba59d7a0cb None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.720297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 159/305] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:01.720297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd68d9e-5cf2-4cca-a3dd-19ba59d7a0cb None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:01.783994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bfbc5-203a-4bf0-b7d6-ccd2635563c3 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:01.816582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b9a44-612b-4331-ba67-892fa179aadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:01.817432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b9a44-612b-4331-ba67-892fa179aadf None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.818221 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b9a44-612b-4331-ba67-892fa179aadf None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.818491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b9a44-612b-4331-ba67-892fa179aadf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.819667 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b9a44-612b-4331-ba67-892fa179aadf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:01.821088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b9a44-612b-4331-ba67-892fa179aadf None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:01.822685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 147/306] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:01.823453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b9a44-612b-4331-ba67-892fa179aadf None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:01.829130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd68d9e-5cf2-4cca-a3dd-19ba59d7a0cb None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:01.874363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f6519-3f5d-4208-800f-c0c57df2b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:01.875034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6519-3f5d-4208-800f-c0c57df2b94c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.875343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6519-3f5d-4208-800f-c0c57df2b94c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.875615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6519-3f5d-4208-800f-c0c57df2b94c None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.876370 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f6519-3f5d-4208-800f-c0c57df2b94c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:01.876696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f6519-3f5d-4208-800f-c0c57df2b94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:01.878079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f6519-3f5d-4208-800f-c0c57df2b94c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:01.886204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 160/307] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:01.887364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a67af-bb65-447c-958f-bc0a08035329 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.887652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a67af-bb65-447c-958f-bc0a08035329 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.887923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a67af-bb65-447c-958f-bc0a08035329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.903978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0e3a67af-bb65-447c-958f-bc0a08035329 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:01.905481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0e3a67af-bb65-447c-958f-bc0a08035329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:01.932167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b9a44-612b-4331-ba67-892fa179aadf None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:01.964984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:01.965627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:01.965898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:01.966165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:01.966979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] RBAC: Adding query filter params (role.id=0bf71370710241c1a66971b7dc2b2b6a, user.id=da2647a83bb7457eb4ef7f16b9e98965, scope.system=all) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:01.967282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:01.968851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:01.973007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 161/308] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:01.985272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 148/309] 10.222.0.93 () {56 vars in 1308 bytes} [Wed May 11 18:44:01 2022] GET /identity/v3/role_assignments?user.id=da2647a83bb7457eb4ef7f16b9e98965&scope.system=all&role.id=0bf71370710241c1a66971b7dc2b2b6a => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:01.985481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a67af-bb65-447c-958f-bc0a08035329 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:01.985559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:02.084459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b87b4-82d9-4c1e-ba61-31929cb037e7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.106361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a67af-bb65-447c-958f-bc0a08035329 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.121039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596c2e7-2819-4aab-ad16-5c5833696cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.121929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c2e7-2819-4aab-ad16-5c5833696cfa None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.122219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c2e7-2819-4aab-ad16-5c5833696cfa None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.122483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c2e7-2819-4aab-ad16-5c5833696cfa None admin] PATH_INFO: `/v3/users/66b169f33ad64a128185dce32ddd4138` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.124080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596c2e7-2819-4aab-ad16-5c5833696cfa None admin] RBAC: Authorizing `identity:get_user(user_id=66b169f33ad64a128185dce32ddd4138)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:02.125696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596c2e7-2819-4aab-ad16-5c5833696cfa None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:02.133034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 149/310] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:44:01 2022] GET /identity/v3/users/66b169f33ad64a128185dce32ddd4138 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:02.133034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596c2e7-2819-4aab-ad16-5c5833696cfa None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:02.149891 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7e941-3293-4190-91a4-3e8ea3bba7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.150655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e941-3293-4190-91a4-3e8ea3bba7ca None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.151028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e941-3293-4190-91a4-3e8ea3bba7ca None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.151560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e941-3293-4190-91a4-3e8ea3bba7ca None admin] PATH_INFO: `/v3/groups` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.152266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7e941-3293-4190-91a4-3e8ea3bba7ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:02.153725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7e941-3293-4190-91a4-3e8ea3bba7ca None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:02.170619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 162/311] 10.222.0.93 () {60 vars in 1134 bytes} [Wed May 11 18:44:01 2022] POST /identity/v3/groups => generated 229 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:02.171878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7e941-3293-4190-91a4-3e8ea3bba7ca None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:02.280042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596c2e7-2819-4aab-ad16-5c5833696cfa None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.308773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7e941-3293-4190-91a4-3e8ea3bba7ca None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.330631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f916ad-1e6a-4839-b2d0-8e990dbbc2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.331481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f916ad-1e6a-4839-b2d0-8e990dbbc2a7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.331765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f916ad-1e6a-4839-b2d0-8e990dbbc2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.332042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f916ad-1e6a-4839-b2d0-8e990dbbc2a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.349742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f916ad-1e6a-4839-b2d0-8e990dbbc2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:02.350702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f823e-bf82-4f36-96ef-44dbd7aef357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.351704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f823e-bf82-4f36-96ef-44dbd7aef357 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.352185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f823e-bf82-4f36-96ef-44dbd7aef357 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.352698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f823e-bf82-4f36-96ef-44dbd7aef357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-b9f916ad-1e6a-4839-b2d0-8e990dbbc2a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:02.361108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:02.362028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:02.362811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 150/312] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:02.369574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f916ad-1e6a-4839-b2d0-8e990dbbc2a7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:02.443959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f823e-bf82-4f36-96ef-44dbd7aef357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:02.445443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f823e-bf82-4f36-96ef-44dbd7aef357 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:02.504111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f916ad-1e6a-4839-b2d0-8e990dbbc2a7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.548670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.549357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.549950 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.550226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.551263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] RBAC: Adding query filter params (name=member) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:02.551598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:02.561015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:02.563857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 163/313] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:02.575107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 151/314] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:02.575283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f823e-bf82-4f36-96ef-44dbd7aef357 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:02.580357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:02.675608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f823e-bf82-4f36-96ef-44dbd7aef357 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.684347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ad34c-7bfc-48ed-9b2e-1ba674aef144 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.712185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e048e-da04-4649-b590-4a8e8b9deb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.713024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e048e-da04-4649-b590-4a8e8b9deb3f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.713305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e048e-da04-4649-b590-4a8e8b9deb3f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.713574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e048e-da04-4649-b590-4a8e8b9deb3f None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.714775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e048e-da04-4649-b590-4a8e8b9deb3f None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:02.716251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e048e-da04-4649-b590-4a8e8b9deb3f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:02.718190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 164/315] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:02 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:02.722192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ecfea-3bdd-4582-9a02-a9390c17bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.723215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecfea-3bdd-4582-9a02-a9390c17bde3 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.723527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecfea-3bdd-4582-9a02-a9390c17bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.723858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecfea-3bdd-4582-9a02-a9390c17bde3 None admin] PATH_INFO: `/v3/users/c4531bdb47f54e97ae2f2aedb1e54132` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.724053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e048e-da04-4649-b590-4a8e8b9deb3f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:02.725082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ecfea-3bdd-4582-9a02-a9390c17bde3 None admin] RBAC: Authorizing `identity:get_user(user_id=c4531bdb47f54e97ae2f2aedb1e54132)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:02.726544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ecfea-3bdd-4582-9a02-a9390c17bde3 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:02.728738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 152/316] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:44:02 2022] GET /identity/v3/users/c4531bdb47f54e97ae2f2aedb1e54132 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:02.734200 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ecfea-3bdd-4582-9a02-a9390c17bde3 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:02.836648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e048e-da04-4649-b590-4a8e8b9deb3f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.855882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ecfea-3bdd-4582-9a02-a9390c17bde3 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:02.879710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3dd85-bdc2-400b-899a-4f8a801b5996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.881532 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3dd85-bdc2-400b-899a-4f8a801b5996 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.882180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3dd85-bdc2-400b-899a-4f8a801b5996 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.882999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3dd85-bdc2-400b-899a-4f8a801b5996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.884356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3dd85-bdc2-400b-899a-4f8a801b5996 None admin] RBAC: Adding query filter params (role.id=0bf71370710241c1a66971b7dc2b2b6a, scope.project.id=f0730edd303b4a70a18988aaf37dbc60, user.id=66b169f33ad64a128185dce32ddd4138) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:02.885027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3dd85-bdc2-400b-899a-4f8a801b5996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:02.887386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3dd85-bdc2-400b-899a-4f8a801b5996 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:02.890109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8c5df-f1c0-4177-b245-6de44d6bcb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:02.891213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8c5df-f1c0-4177-b245-6de44d6bcb10 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:02.891358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8c5df-f1c0-4177-b245-6de44d6bcb10 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:02.891634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8c5df-f1c0-4177-b245-6de44d6bcb10 None admin] PATH_INFO: `/v3/system/users/c4531bdb47f54e97ae2f2aedb1e54132/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:02.893165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8c5df-f1c0-4177-b245-6de44d6bcb10 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c4531bdb47f54e97ae2f2aedb1e54132, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:02.894527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8c5df-f1c0-4177-b245-6de44d6bcb10 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:02.895178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 165/317] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:02 2022] GET /identity/v3/role_assignments?user.id=66b169f33ad64a128185dce32ddd4138&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=0bf71370710241c1a66971b7dc2b2b6a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:02.911363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 153/318] 10.222.0.93 () {58 vars in 1334 bytes} [Wed May 11 18:44:02 2022] PUT /identity/v3/system/users/c4531bdb47f54e97ae2f2aedb1e54132/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:44:04.287733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f192-2dae-42ff-abec-13fe8a35d055 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.288262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f192-2dae-42ff-abec-13fe8a35d055 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.288262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f192-2dae-42ff-abec-13fe8a35d055 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.289648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 166/319] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:04.295002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d15a-8511-4694-9689-ce25a3072c7b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.295422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d15a-8511-4694-9689-ce25a3072c7b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.295582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d15a-8511-4694-9689-ce25a3072c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.312627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-5493d15a-8511-4694-9689-ce25a3072c7b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:04.313856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5493d15a-8511-4694-9689-ce25a3072c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:04.384283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 154/320] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:04.407239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f192-2dae-42ff-abec-13fe8a35d055 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:04.510654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f192-2dae-42ff-abec-13fe8a35d055 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:04.521909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c3dda-04e4-45e1-b469-fbcfd7c2a32e None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.522193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c3dda-04e4-45e1-b469-fbcfd7c2a32e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.522459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c3dda-04e4-45e1-b469-fbcfd7c2a32e None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.523989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 155/321] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:04.528775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c507cb-200d-4ad1-a185-d55a32858620 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.529058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c507cb-200d-4ad1-a185-d55a32858620 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.529330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c507cb-200d-4ad1-a185-d55a32858620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.545670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3132d36-4928-4215-919c-7d3a4761c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:04.545904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132d36-4928-4215-919c-7d3a4761c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.546195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132d36-4928-4215-919c-7d3a4761c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.546468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132d36-4928-4215-919c-7d3a4761c6b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.555719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c8c507cb-200d-4ad1-a185-d55a32858620 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:04.556973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c8c507cb-200d-4ad1-a185-d55a32858620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:04.559951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3132d36-4928-4215-919c-7d3a4761c6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-b3132d36-4928-4215-919c-7d3a4761c6b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:04.568761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:04.569781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:44:04.570737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:04.572775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 167/322] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:04.578449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3132d36-4928-4215-919c-7d3a4761c6b1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:04.624517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 156/323] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:04.647942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c507cb-200d-4ad1-a185-d55a32858620 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:04.688296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3132d36-4928-4215-919c-7d3a4761c6b1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:04.724846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:04.725523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.725866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.726144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.726947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:04.727259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:04.728710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:04.736745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 168/324] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:04.742700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:04.746642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c507cb-200d-4ad1-a185-d55a32858620 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:04.781217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ee307-4322-47e4-a466-a645a7b7b942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:04.781939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ee307-4322-47e4-a466-a645a7b7b942 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.782220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ee307-4322-47e4-a466-a645a7b7b942 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.782493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ee307-4322-47e4-a466-a645a7b7b942 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.783691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ee307-4322-47e4-a466-a645a7b7b942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:04.785147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ee307-4322-47e4-a466-a645a7b7b942 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:04.787496 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 157/325] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:04.792748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ee307-4322-47e4-a466-a645a7b7b942 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:04.849487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839162e0-21cb-4cc6-97c1-7a371ab0e29c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:04.882131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b70c1-a0c7-455e-9c82-280a2c34e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:04.883359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b70c1-a0c7-455e-9c82-280a2c34e46f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.883843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b70c1-a0c7-455e-9c82-280a2c34e46f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.884313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b70c1-a0c7-455e-9c82-280a2c34e46f None admin] PATH_INFO: `/v3/users/da2647a83bb7457eb4ef7f16b9e98965` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.885747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b70c1-a0c7-455e-9c82-280a2c34e46f None admin] RBAC: Authorizing `identity:get_user(user_id=da2647a83bb7457eb4ef7f16b9e98965)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:04.887937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b70c1-a0c7-455e-9c82-280a2c34e46f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:04.888998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ee307-4322-47e4-a466-a645a7b7b942 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:04.890315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 169/326] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:44:04 2022] GET /identity/v3/users/da2647a83bb7457eb4ef7f16b9e98965 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:04.895451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b70c1-a0c7-455e-9c82-280a2c34e46f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:04.929335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461feb-e325-458c-93ea-260260bcd89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:04.930058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461feb-e325-458c-93ea-260260bcd89d None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:04.930339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461feb-e325-458c-93ea-260260bcd89d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:04.930620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461feb-e325-458c-93ea-260260bcd89d None admin] PATH_INFO: `/v3/groups` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:04.931313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f461feb-e325-458c-93ea-260260bcd89d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:04.932780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f461feb-e325-458c-93ea-260260bcd89d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:04.948572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 158/327] 10.222.0.93 () {60 vars in 1134 bytes} [Wed May 11 18:44:04 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:44:05.008673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b70c1-a0c7-455e-9c82-280a2c34e46f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:05.046472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7edd07-6c4a-4863-8ed8-04909353071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:05.047720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7edd07-6c4a-4863-8ed8-04909353071f None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:05.048273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7edd07-6c4a-4863-8ed8-04909353071f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:05.048800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7edd07-6c4a-4863-8ed8-04909353071f None admin] PATH_INFO: `/v3/system/users/da2647a83bb7457eb4ef7f16b9e98965/roles/0bf71370710241c1a66971b7dc2b2b6a` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:05.050657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7edd07-6c4a-4863-8ed8-04909353071f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=da2647a83bb7457eb4ef7f16b9e98965, role_id=0bf71370710241c1a66971b7dc2b2b6a)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:05.052414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7edd07-6c4a-4863-8ed8-04909353071f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:05.068085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 170/328] 10.222.0.93 () {58 vars in 1334 bytes} [Wed May 11 18:44:04 2022] PUT /identity/v3/system/users/da2647a83bb7457eb4ef7f16b9e98965/roles/0bf71370710241c1a66971b7dc2b2b6a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:44:05.167705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bac02-a768-4b05-83e8-b145347250de None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:05.168029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bac02-a768-4b05-83e8-b145347250de None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:05.168259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bac02-a768-4b05-83e8-b145347250de None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:05.169687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 159/329] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:05.175877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900d1e8-d4f2-46ef-a9af-ebb451fe9fb3 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:05.176159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900d1e8-d4f2-46ef-a9af-ebb451fe9fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:05.176429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900d1e8-d4f2-46ef-a9af-ebb451fe9fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:05.195623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7900d1e8-d4f2-46ef-a9af-ebb451fe9fb3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:05.196855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7900d1e8-d4f2-46ef-a9af-ebb451fe9fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:05.275774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 171/330] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:05.299255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bac02-a768-4b05-83e8-b145347250de None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:05.405073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bac02-a768-4b05-83e8-b145347250de None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:05.447170 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7ab4f-b30e-4c64-8508-727fe2c1299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:05.448005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7ab4f-b30e-4c64-8508-727fe2c1299f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:05.448284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7ab4f-b30e-4c64-8508-727fe2c1299f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:05.448556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7ab4f-b30e-4c64-8508-727fe2c1299f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:05.459362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7ab4f-b30e-4c64-8508-727fe2c1299f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-b6c7ab4f-b30e-4c64-8508-727fe2c1299f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:05.467255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:05.468287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:05.469446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 160/331] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:05.474785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900d1e8-d4f2-46ef-a9af-ebb451fe9fb3 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:05.579506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900d1e8-d4f2-46ef-a9af-ebb451fe9fb3 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:05.616458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:05.617140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:05.617422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:05.617696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:05.618454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:05.618758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:05.620174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:05.629149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 172/332] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:05.634769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7ab4f-b30e-4c64-8508-727fe2c1299f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:05.748319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7ab4f-b30e-4c64-8508-727fe2c1299f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:05.783660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8d055-cf36-44e6-a39d-50f73bcb129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:05.784546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d055-cf36-44e6-a39d-50f73bcb129c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:05.784825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d055-cf36-44e6-a39d-50f73bcb129c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:05.785096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d055-cf36-44e6-a39d-50f73bcb129c None admin] PATH_INFO: `/v3/users/c4531bdb47f54e97ae2f2aedb1e54132` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:05.786819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8d055-cf36-44e6-a39d-50f73bcb129c None admin] RBAC: Authorizing `identity:get_user(user_id=c4531bdb47f54e97ae2f2aedb1e54132)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:05.788309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8d055-cf36-44e6-a39d-50f73bcb129c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:05.790252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 161/333] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:44:05 2022] GET /identity/v3/users/c4531bdb47f54e97ae2f2aedb1e54132 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:05.796688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:05.928565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44995371-9172-4ca8-86e6-a2fccd14e457 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:05.971706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb1c01-cd74-4f97-b61e-b445cbd1bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:05.972739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1c01-cd74-4f97-b61e-b445cbd1bb6d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:05.973221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1c01-cd74-4f97-b61e-b445cbd1bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:05.973727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1c01-cd74-4f97-b61e-b445cbd1bb6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:05.974797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb1c01-cd74-4f97-b61e-b445cbd1bb6d None admin] RBAC: Adding query filter params (role.id=39757d16971a48b6836913cd1908f48e, user.id=c4531bdb47f54e97ae2f2aedb1e54132, scope.system=all) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:05.975331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb1c01-cd74-4f97-b61e-b445cbd1bb6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:05.976974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb1c01-cd74-4f97-b61e-b445cbd1bb6d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:05.993163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 173/334] 10.222.0.93 () {56 vars in 1308 bytes} [Wed May 11 18:44:05 2022] GET /identity/v3/role_assignments?user.id=c4531bdb47f54e97ae2f2aedb1e54132&scope.system=all&role.id=39757d16971a48b6836913cd1908f48e => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:07.550454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afabb5-46d6-4a2d-ba94-e9ecf3d3620f None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:07.551493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afabb5-46d6-4a2d-ba94-e9ecf3d3620f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:07.552525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afabb5-46d6-4a2d-ba94-e9ecf3d3620f None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:07.554382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 162/335] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:07.559637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0690b-4844-486d-822d-fd977852cb68 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:07.560082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0690b-4844-486d-822d-fd977852cb68 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:07.560182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0690b-4844-486d-822d-fd977852cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:07.581076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3be0690b-4844-486d-822d-fd977852cb68 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:07.582550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3be0690b-4844-486d-822d-fd977852cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:07.672061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 174/336] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:07.704016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afabb5-46d6-4a2d-ba94-e9ecf3d3620f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:07.736954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a06573-b3b7-4110-b0a0-ac93d0e761fe None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:07.737535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a06573-b3b7-4110-b0a0-ac93d0e761fe None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:07.738043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a06573-b3b7-4110-b0a0-ac93d0e761fe None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:07.740174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 175/337] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:07.745848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171ad0-616e-4a48-8c1c-3a8ccfe6b200 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:07.746348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171ad0-616e-4a48-8c1c-3a8ccfe6b200 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:07.746801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171ad0-616e-4a48-8c1c-3a8ccfe6b200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:07.789781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-4e171ad0-616e-4a48-8c1c-3a8ccfe6b200 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:07.791333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4e171ad0-616e-4a48-8c1c-3a8ccfe6b200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:07.906751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afabb5-46d6-4a2d-ba94-e9ecf3d3620f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:07.910195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 176/338] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:07.914043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269dd4e-d27c-4b9f-bf80-eb6c0c6b61c1 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:07.919315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269dd4e-d27c-4b9f-bf80-eb6c0c6b61c1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:07.919890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269dd4e-d27c-4b9f-bf80-eb6c0c6b61c1 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:07.921800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 177/339] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:07.932748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7ca9-6c0a-49b9-9c51-aed76907b9a7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:07.933316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7ca9-6c0a-49b9-9c51-aed76907b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:07.933810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7ca9-6c0a-49b9-9c51-aed76907b9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:07.947968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb775d5-94fd-4065-9fb2-f83ba8e3aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:07.949094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb775d5-94fd-4065-9fb2-f83ba8e3aee0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:07.949536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb775d5-94fd-4065-9fb2-f83ba8e3aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:07.949983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb775d5-94fd-4065-9fb2-f83ba8e3aee0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:07.964591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-572a7ca9-6c0a-49b9-9c51-aed76907b9a7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:07.965924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-572a7ca9-6c0a-49b9-9c51-aed76907b9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:07.968646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb775d5-94fd-4065-9fb2-f83ba8e3aee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-fdb775d5-94fd-4065-9fb2-f83ba8e3aee0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:07.976863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:07.977746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 18:44:07.978507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:07.981155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 163/340] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:07.982139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb775d5-94fd-4065-9fb2-f83ba8e3aee0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.037988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 178/341] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:08.038994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7ca9-6c0a-49b9-9c51-aed76907b9a7 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.106178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb775d5-94fd-4065-9fb2-f83ba8e3aee0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.140907 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7ca9-6c0a-49b9-9c51-aed76907b9a7 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.148134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875683-a06c-4e80-82ad-93df33dc7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.149146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875683-a06c-4e80-82ad-93df33dc7cf2 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.149569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875683-a06c-4e80-82ad-93df33dc7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.150044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875683-a06c-4e80-82ad-93df33dc7cf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:08.162113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5875683-a06c-4e80-82ad-93df33dc7cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-b5875683-a06c-4e80-82ad-93df33dc7cf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:08.170320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:08.171160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:08.171964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:08.174463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 164/342] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:08.175723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875683-a06c-4e80-82ad-93df33dc7cf2 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.177274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.177937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.178393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.178814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:08.179840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:08.180331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:08.181929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:08.190860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 179/343] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:08.192034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.280952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875683-a06c-4e80-82ad-93df33dc7cf2 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.293998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef43122-2b3b-431e-b4b8-64d0c4a4d3b5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.315742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc883f9-b658-4c22-a9ed-e554d000fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.316926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc883f9-b658-4c22-a9ed-e554d000fb51 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.317348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc883f9-b658-4c22-a9ed-e554d000fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.317789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc883f9-b658-4c22-a9ed-e554d000fb51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:08.329745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.330411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc883f9-b658-4c22-a9ed-e554d000fb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:08.330667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.331167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.331666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:08.332715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:08.333758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:08.335368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-5cc883f9-b658-4c22-a9ed-e554d000fb51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:08.339351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:08.340290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:08.341089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:08.343674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 165/344] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:44:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:08.344627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc883f9-b658-4c22-a9ed-e554d000fb51 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.345288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 180/345] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:08.352369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.450359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc883f9-b658-4c22-a9ed-e554d000fb51 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.485474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e99c17-ebda-491b-a42a-5714d4298e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.486643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e99c17-ebda-491b-a42a-5714d4298e9c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.487098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e99c17-ebda-491b-a42a-5714d4298e9c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.487591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e99c17-ebda-491b-a42a-5714d4298e9c None admin] PATH_INFO: `/v3/users/da2647a83bb7457eb4ef7f16b9e98965` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:08.489030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e99c17-ebda-491b-a42a-5714d4298e9c None admin] RBAC: Authorizing `identity:get_user(user_id=da2647a83bb7457eb4ef7f16b9e98965)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:08.491386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e99c17-ebda-491b-a42a-5714d4298e9c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:08.493359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 166/346] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:44:08 2022] GET /identity/v3/users/da2647a83bb7457eb4ef7f16b9e98965 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:08.494324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e99c17-ebda-491b-a42a-5714d4298e9c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.590961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd45ee-3654-46fe-9e9a-2f1b263cc418 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.597880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e99c17-ebda-491b-a42a-5714d4298e9c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.633340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.634308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.634765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.635238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:08.636268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:08.636764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:08.638393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:08.648824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 167/347] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:08.649994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.673500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be165d65-c69a-4570-a634-c89c7065d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.674165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165d65-c69a-4570-a634-c89c7065d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.674443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165d65-c69a-4570-a634-c89c7065d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.674714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165d65-c69a-4570-a634-c89c7065d9e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:08.759674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ead97-6121-46da-a9ea-6b5c54e81706 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.794689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.796137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.796600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.797121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:08.798138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] RBAC: Adding query filter params (role.id=0bf71370710241c1a66971b7dc2b2b6a, user.id=da2647a83bb7457eb4ef7f16b9e98965, scope.system=all) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:08.798673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:08.800319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:08.815049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 168/348] 10.222.0.93 () {56 vars in 1308 bytes} [Wed May 11 18:44:08 2022] GET /identity/v3/role_assignments?user.id=da2647a83bb7457eb4ef7f16b9e98965&scope.system=all&role.id=0bf71370710241c1a66971b7dc2b2b6a => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:08.816528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:08.840660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be165d65-c69a-4570-a634-c89c7065d9e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:08.842143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be165d65-c69a-4570-a634-c89c7065d9e0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:08.931423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97f977-b891-4a86-85b5-929124006535 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:08.968252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e90ea-c6b5-4021-93f5-1b372d1efdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:08.969237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e90ea-c6b5-4021-93f5-1b372d1efdc2 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:08.969704 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e90ea-c6b5-4021-93f5-1b372d1efdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:08.970150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e90ea-c6b5-4021-93f5-1b372d1efdc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.044302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e90ea-c6b5-4021-93f5-1b372d1efdc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:09.046104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e90ea-c6b5-4021-93f5-1b372d1efdc2 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:09.105857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 181/349] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:09.107170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140c51-7c03-42f6-a0a1-ba949ecb83f6 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.107596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140c51-7c03-42f6-a0a1-ba949ecb83f6 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.107787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140c51-7c03-42f6-a0a1-ba949ecb83f6 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.109031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 182/350] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:09.116559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9b8d8-5d3c-4dc8-a7c3-55f63d124af4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.116837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9b8d8-5d3c-4dc8-a7c3-55f63d124af4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.117111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9b8d8-5d3c-4dc8-a7c3-55f63d124af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.137587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e0b9b8d8-5d3c-4dc8-a7c3-55f63d124af4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:09.138774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e0b9b8d8-5d3c-4dc8-a7c3-55f63d124af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:09.150304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 169/351] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:09.151465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e90ea-c6b5-4021-93f5-1b372d1efdc2 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.242816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 183/352] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:09.243712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9b8d8-5d3c-4dc8-a7c3-55f63d124af4 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.284847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e90ea-c6b5-4021-93f5-1b372d1efdc2 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:09.326195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02a1d-86ba-4a46-a9b6-b45e7baf575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:09.327281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02a1d-86ba-4a46-a9b6-b45e7baf575d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.327732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02a1d-86ba-4a46-a9b6-b45e7baf575d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.328150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02a1d-86ba-4a46-a9b6-b45e7baf575d None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.329510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d02a1d-86ba-4a46-a9b6-b45e7baf575d None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:09.331123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d02a1d-86ba-4a46-a9b6-b45e7baf575d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:09.333075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 170/353] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:09.333992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02a1d-86ba-4a46-a9b6-b45e7baf575d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.362195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9b8d8-5d3c-4dc8-a7c3-55f63d124af4 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:09.397656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940ff6c-2f31-45e0-8ed0-bbe8f2ab00a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:09.398409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ff6c-2f31-45e0-8ed0-bbe8f2ab00a3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.398744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ff6c-2f31-45e0-8ed0-bbe8f2ab00a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.399019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ff6c-2f31-45e0-8ed0-bbe8f2ab00a3 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.400249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940ff6c-2f31-45e0-8ed0-bbe8f2ab00a3 None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:09.401724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940ff6c-2f31-45e0-8ed0-bbe8f2ab00a3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:09.403401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 184/354] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:09.404128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940ff6c-2f31-45e0-8ed0-bbe8f2ab00a3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.444511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02a1d-86ba-4a46-a9b6-b45e7baf575d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:09.481431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef15f79-bffa-438b-9dd2-f3d488caa446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:09.482658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef15f79-bffa-438b-9dd2-f3d488caa446 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.483145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef15f79-bffa-438b-9dd2-f3d488caa446 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.483655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef15f79-bffa-438b-9dd2-f3d488caa446 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.495098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef15f79-bffa-438b-9dd2-f3d488caa446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-5ef15f79-bffa-438b-9dd2-f3d488caa446 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:09.503214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:09.504133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:09.505452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:09.506057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940ff6c-2f31-45e0-8ed0-bbe8f2ab00a3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:09.508166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 171/355] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:09.509169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef15f79-bffa-438b-9dd2-f3d488caa446 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.540954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13043-f459-4606-96a0-6b02d31f8c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:09.541713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13043-f459-4606-96a0-6b02d31f8c22 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.541993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13043-f459-4606-96a0-6b02d31f8c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.542261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13043-f459-4606-96a0-6b02d31f8c22 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.548630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df13043-f459-4606-96a0-6b02d31f8c22 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:09.550152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df13043-f459-4606-96a0-6b02d31f8c22 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:09.553435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 185/356] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:09.554209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13043-f459-4606-96a0-6b02d31f8c22 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.615405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef15f79-bffa-438b-9dd2-f3d488caa446 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:09.650573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b1572-ce1c-43f2-8114-21d9d2396cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:09.651833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1572-ce1c-43f2-8114-21d9d2396cb3 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.652340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1572-ce1c-43f2-8114-21d9d2396cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.652813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1572-ce1c-43f2-8114-21d9d2396cb3 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.654211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b1572-ce1c-43f2-8114-21d9d2396cb3 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:09.655898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b1572-ce1c-43f2-8114-21d9d2396cb3 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:09.658065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 172/357] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:09.659048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b1572-ce1c-43f2-8114-21d9d2396cb3 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.660879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13043-f459-4606-96a0-6b02d31f8c22 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:09.697511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:09.698185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.698521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.698797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.699627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:09.699930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:09.701305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:09.713146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 186/358] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:09.714209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.771855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b1572-ce1c-43f2-8114-21d9d2396cb3 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:09.811663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:09.812334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.812611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.812881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.813715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] RBAC: Adding query filter params (group.id=b94937ed951c4ba3b651d68a79716ddf, role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=fd89398693a247abb18b91b7cd6b5840) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:09.814025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:09.815753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:09.823928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 173/359] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/role_assignments?group.id=b94937ed951c4ba3b651d68a79716ddf&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=39757d16971a48b6836913cd1908f48e => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:09.827999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:09.868114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1cb58-81a2-4731-885a-124435549e0f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:09.948012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e3295-36e6-4cc8-b071-c1f72c590510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:09.949152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3295-36e6-4cc8-b071-c1f72c590510 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.949656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3295-36e6-4cc8-b071-c1f72c590510 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.950136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3295-36e6-4cc8-b071-c1f72c590510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.952042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e3295-36e6-4cc8-b071-c1f72c590510 None admin] RBAC: Adding query filter params (group.id=b94937ed951c4ba3b651d68a79716ddf, role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=fd89398693a247abb18b91b7cd6b5840) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:09.952779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e3295-36e6-4cc8-b071-c1f72c590510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:09.956029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e3295-36e6-4cc8-b071-c1f72c590510 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:09.967109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 187/360] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/role_assignments?group.id=b94937ed951c4ba3b651d68a79716ddf&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:09.984385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454ff8b-2d83-4a0a-878d-15d03de7a380 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.985027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454ff8b-2d83-4a0a-878d-15d03de7a380 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.985520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454ff8b-2d83-4a0a-878d-15d03de7a380 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:09.987558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 188/361] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:44:09.995179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fe3a-5c5d-43d8-bef7-9243afec6026 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:09.995604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fe3a-5c5d-43d8-bef7-9243afec6026 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:09.995768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fe3a-5c5d-43d8-bef7-9243afec6026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.012681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768f677-e8bb-48a0-9749-e49d3563bbea None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:10.013833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-cf11fe3a-5c5d-43d8-bef7-9243afec6026 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:10.015057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-cf11fe3a-5c5d-43d8-bef7-9243afec6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:10.050511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd349a-9dde-4074-8e04-cc10efd1a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:10.051182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd349a-9dde-4074-8e04-cc10efd1a008 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.051498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd349a-9dde-4074-8e04-cc10efd1a008 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.051802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd349a-9dde-4074-8e04-cc10efd1a008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.094093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 189/362] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:10.123282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11fe3a-5c5d-43d8-bef7-9243afec6026 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:10.146414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd349a-9dde-4074-8e04-cc10efd1a008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:10.147994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd349a-9dde-4074-8e04-cc10efd1a008 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:10.251972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11fe3a-5c5d-43d8-bef7-9243afec6026 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:10.265138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 174/363] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:10.274106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd349a-9dde-4074-8e04-cc10efd1a008 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:10.319983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45dffc-eb9a-44ae-bfc2-01f7fe0d5af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:10.320811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45dffc-eb9a-44ae-bfc2-01f7fe0d5af4 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.321088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45dffc-eb9a-44ae-bfc2-01f7fe0d5af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.321358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45dffc-eb9a-44ae-bfc2-01f7fe0d5af4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.342162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45dffc-eb9a-44ae-bfc2-01f7fe0d5af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-dc45dffc-eb9a-44ae-bfc2-01f7fe0d5af4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:10.354502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:10.355519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:10.356341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 190/364] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:10.362878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45dffc-eb9a-44ae-bfc2-01f7fe0d5af4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:10.423433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd349a-9dde-4074-8e04-cc10efd1a008 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:10.460135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392559ea-6e78-4371-ab8e-f7a6dd71f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:10.461212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392559ea-6e78-4371-ab8e-f7a6dd71f0ed None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.461489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392559ea-6e78-4371-ab8e-f7a6dd71f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.461756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392559ea-6e78-4371-ab8e-f7a6dd71f0ed None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.462956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392559ea-6e78-4371-ab8e-f7a6dd71f0ed None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:10.464416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392559ea-6e78-4371-ab8e-f7a6dd71f0ed None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:10.466416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 175/365] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:10 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:10.467680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512275-3e11-4cfe-b527-7aec14e797ab None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.467960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512275-3e11-4cfe-b527-7aec14e797ab None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.468227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512275-3e11-4cfe-b527-7aec14e797ab None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.469682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 176/366] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:10.474980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e900d-8d7c-498e-9403-37525b0149c4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.475244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e900d-8d7c-498e-9403-37525b0149c4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.475550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e900d-8d7c-498e-9403-37525b0149c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.486186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45dffc-eb9a-44ae-bfc2-01f7fe0d5af4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:10.493918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-295e900d-8d7c-498e-9403-37525b0149c4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:10.495092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-295e900d-8d7c-498e-9403-37525b0149c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:10.522874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:10.523575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.523856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.524126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.524871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:10.525175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:10.526582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:10.536917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 191/367] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:10.537779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:10.572469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 177/368] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:10.573466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e900d-8d7c-498e-9403-37525b0149c4 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:10.659865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7be8d-5afb-4654-b5ac-1ca5c9674bb8 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:10.688696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e900d-8d7c-498e-9403-37525b0149c4 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:10.701748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82e0e-ccdf-43fb-b081-a9b0f46c5657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:10.703107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e0e-ccdf-43fb-b081-a9b0f46c5657 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.703441 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e0e-ccdf-43fb-b081-a9b0f46c5657 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.703718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a82e0e-ccdf-43fb-b081-a9b0f46c5657 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.705338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a82e0e-ccdf-43fb-b081-a9b0f46c5657 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:10.707084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a82e0e-ccdf-43fb-b081-a9b0f46c5657 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:10.709696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 192/369] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:10 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:10.715371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82e0e-ccdf-43fb-b081-a9b0f46c5657 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:10.732485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf40d6-3ea0-4ca5-9dc4-d63bc83fd25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:10.733182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf40d6-3ea0-4ca5-9dc4-d63bc83fd25c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.733455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf40d6-3ea0-4ca5-9dc4-d63bc83fd25c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.733778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf40d6-3ea0-4ca5-9dc4-d63bc83fd25c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.808979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf40d6-3ea0-4ca5-9dc4-d63bc83fd25c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:10.810449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf40d6-3ea0-4ca5-9dc4-d63bc83fd25c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:10.834717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a82e0e-ccdf-43fb-b081-a9b0f46c5657 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:10.869426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4fb1b-2906-4e31-8b13-f48c6aa58687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:10.870277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4fb1b-2906-4e31-8b13-f48c6aa58687 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:10.870560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4fb1b-2906-4e31-8b13-f48c6aa58687 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:10.870832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4fb1b-2906-4e31-8b13-f48c6aa58687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:10.882048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4fb1b-2906-4e31-8b13-f48c6aa58687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-7df4fb1b-2906-4e31-8b13-f48c6aa58687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:10.896495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:10.897508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:10.898288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 193/370] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:10.898944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4fb1b-2906-4e31-8b13-f48c6aa58687 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:10.910475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 178/371] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:10.911391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf40d6-3ea0-4ca5-9dc4-d63bc83fd25c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:11.003680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4fb1b-2906-4e31-8b13-f48c6aa58687 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:11.011717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf40d6-3ea0-4ca5-9dc4-d63bc83fd25c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:11.048569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:11.049244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:11.049517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:11.049784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:11.050533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:11.050831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:11.052524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:11.052918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:11.053594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:11.053875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:11.054196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:11.055078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] RBAC: Adding query filter params (group.id=b94937ed951c4ba3b651d68a79716ddf, role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=f0730edd303b4a70a18988aaf37dbc60) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:11.055415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:11.056940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:11.061939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 179/372] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:11.062770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:11.066977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 194/373] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:10 2022] GET /identity/v3/role_assignments?group.id=b94937ed951c4ba3b651d68a79716ddf&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=39757d16971a48b6836913cd1908f48e => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:11.068689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:11.170742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64c47-554e-4360-afc6-eed30eb25323 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:11.219193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c8e4-cf42-4076-8f34-cf74c06abcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:11.220397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c8e4-cf42-4076-8f34-cf74c06abcb8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:11.220865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c8e4-cf42-4076-8f34-cf74c06abcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:11.221318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c8e4-cf42-4076-8f34-cf74c06abcb8 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:11.223973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910c8e4-cf42-4076-8f34-cf74c06abcb8 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:11.225676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910c8e4-cf42-4076-8f34-cf74c06abcb8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:11.227935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 180/374] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:11 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:11.232522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384d9d1-f924-4ca9-8d28-c73b3b39e33e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:11.233865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c8e4-cf42-4076-8f34-cf74c06abcb8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:11.303651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c038a-d9d4-4a67-b6e6-78f5f97bca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:11.304232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c038a-d9d4-4a67-b6e6-78f5f97bca81 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:11.304510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c038a-d9d4-4a67-b6e6-78f5f97bca81 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:11.304780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c038a-d9d4-4a67-b6e6-78f5f97bca81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:11.441404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c8e4-cf42-4076-8f34-cf74c06abcb8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:11.469304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c038a-d9d4-4a67-b6e6-78f5f97bca81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:11.473071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c038a-d9d4-4a67-b6e6-78f5f97bca81 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:11.509527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052158-02f8-4f4b-8c6e-ad28007e4312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:11.511483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052158-02f8-4f4b-8c6e-ad28007e4312 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:11.511940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052158-02f8-4f4b-8c6e-ad28007e4312 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:11.512352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052158-02f8-4f4b-8c6e-ad28007e4312 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:11.515115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b052158-02f8-4f4b-8c6e-ad28007e4312 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:11.516739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b052158-02f8-4f4b-8c6e-ad28007e4312 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:11.520531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 181/375] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:11 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:11.525526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052158-02f8-4f4b-8c6e-ad28007e4312 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:11.688208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 195/376] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:11.694553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c038a-d9d4-4a67-b6e6-78f5f97bca81 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:11.782754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052158-02f8-4f4b-8c6e-ad28007e4312 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:11.860074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c038a-d9d4-4a67-b6e6-78f5f97bca81 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:11.875456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:11.876344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:11.876779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:11.877199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:11.878194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] RBAC: Adding query filter params (group.id=b94937ed951c4ba3b651d68a79716ddf, role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=f0730edd303b4a70a18988aaf37dbc60) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:11.878659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:11.880793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:11.899288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 182/377] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:11 2022] GET /identity/v3/role_assignments?group.id=b94937ed951c4ba3b651d68a79716ddf&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 260 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:11.903467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b844194-6784-4ceb-a27a-37ee3dce7637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:11.904995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844194-6784-4ceb-a27a-37ee3dce7637 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:11.905277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844194-6784-4ceb-a27a-37ee3dce7637 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:11.905551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844194-6784-4ceb-a27a-37ee3dce7637 None admin] PATH_INFO: `/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:11.907103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844194-6784-4ceb-a27a-37ee3dce7637 None admin] RBAC: Authorizing `identity:get_project(project_id=639dcabe7cb941cc82eb0b4e6f620fd4)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:11.909345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844194-6784-4ceb-a27a-37ee3dce7637 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:11.914031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 196/378] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:11 2022] GET /identity/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:11.921243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:12.137178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db18d7-4566-43eb-8db4-53b553cd4888 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:12.225270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608abe55-f56d-4ae5-a4ad-777f61bfe7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:12.226133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608abe55-f56d-4ae5-a4ad-777f61bfe7fc None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:12.227261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608abe55-f56d-4ae5-a4ad-777f61bfe7fc None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:12.227261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608abe55-f56d-4ae5-a4ad-777f61bfe7fc None admin] PATH_INFO: `/v3/groups/c5afb7a655114f12b656b366098fa38e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:12.234777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608abe55-f56d-4ae5-a4ad-777f61bfe7fc None admin] RBAC: Authorizing `identity:get_group(group_id=c5afb7a655114f12b656b366098fa38e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:12.236343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608abe55-f56d-4ae5-a4ad-777f61bfe7fc None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:12.238299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 183/379] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:11 2022] GET /identity/v3/groups/c5afb7a655114f12b656b366098fa38e => generated 229 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:12.244816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b844194-6784-4ceb-a27a-37ee3dce7637 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:12.397254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b844194-6784-4ceb-a27a-37ee3dce7637 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:12.437391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7adde6-eed9-4cd0-87d3-ba77255b0de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:12.438058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adde6-eed9-4cd0-87d3-ba77255b0de8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:12.438338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adde6-eed9-4cd0-87d3-ba77255b0de8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:12.438609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adde6-eed9-4cd0-87d3-ba77255b0de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:12.439483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7adde6-eed9-4cd0-87d3-ba77255b0de8 None admin] RBAC: Adding query filter params (group.id=c5afb7a655114f12b656b366098fa38e, role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=639dcabe7cb941cc82eb0b4e6f620fd4) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:12.439790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7adde6-eed9-4cd0-87d3-ba77255b0de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:12.441484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7adde6-eed9-4cd0-87d3-ba77255b0de8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:12.452163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 197/380] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:12 2022] GET /identity/v3/role_assignments?group.id=c5afb7a655114f12b656b366098fa38e&scope.project.id=639dcabe7cb941cc82eb0b4e6f620fd4&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:12.722553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802132-93dc-44fa-b9c1-5df49a6b7c7a None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:12.725780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802132-93dc-44fa-b9c1-5df49a6b7c7a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:12.725780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802132-93dc-44fa-b9c1-5df49a6b7c7a None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:12.726238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 184/381] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:12.733615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ce76-d945-4756-820f-e1f5d81d4e6c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:12.733615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ce76-d945-4756-820f-e1f5d81d4e6c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:12.733615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ce76-d945-4756-820f-e1f5d81d4e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:12.756241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c8b6ce76-d945-4756-820f-e1f5d81d4e6c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:12.757818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c8b6ce76-d945-4756-820f-e1f5d81d4e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:12.820464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12e6ba-24fe-456b-ac24-bf7d3e45a4a3 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:12.821418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12e6ba-24fe-456b-ac24-bf7d3e45a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:12.822245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12e6ba-24fe-456b-ac24-bf7d3e45a4a3 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:12.825904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 185/382] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:12.829814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385373e3-42b2-405c-821c-f51946323385 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:12.830166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385373e3-42b2-405c-821c-f51946323385 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:12.830361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385373e3-42b2-405c-821c-f51946323385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:12.857206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 198/383] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:12.859185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-385373e3-42b2-405c-821c-f51946323385 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:12.860398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-385373e3-42b2-405c-821c-f51946323385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:12.882780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6ce76-d945-4756-820f-e1f5d81d4e6c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:12.951819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 186/384] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:12.990273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385373e3-42b2-405c-821c-f51946323385 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:13.055556 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6ce76-d945-4756-820f-e1f5d81d4e6c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:13.122455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8fcd-ab4f-46cb-95c1-b183f9c406ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:13.123724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8fcd-ab4f-46cb-95c1-b183f9c406ba None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:13.124205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8fcd-ab4f-46cb-95c1-b183f9c406ba None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:13.124672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8fcd-ab4f-46cb-95c1-b183f9c406ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:13.146538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d8fcd-ab4f-46cb-95c1-b183f9c406ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-a52d8fcd-ab4f-46cb-95c1-b183f9c406ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:13.158193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:13.159104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:13.160404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:13.167347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 199/385] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:13.171971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8fcd-ab4f-46cb-95c1-b183f9c406ba None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:13.179747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385373e3-42b2-405c-821c-f51946323385 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:13.252789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748055e-876f-4d03-a6cb-f8c6d0406d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:13.255453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748055e-876f-4d03-a6cb-f8c6d0406d75 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:13.255453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748055e-876f-4d03-a6cb-f8c6d0406d75 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:13.255453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748055e-876f-4d03-a6cb-f8c6d0406d75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:13.283268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748055e-876f-4d03-a6cb-f8c6d0406d75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-3748055e-876f-4d03-a6cb-f8c6d0406d75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:13.293376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:13.294231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:13.296247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:13.303533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 187/386] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:44:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:13.305923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748055e-876f-4d03-a6cb-f8c6d0406d75 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:13.376297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8fcd-ab4f-46cb-95c1-b183f9c406ba None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:13.419636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748055e-876f-4d03-a6cb-f8c6d0406d75 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:13.432933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:13.433612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:13.433903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:13.434249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:13.435009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:13.435324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:13.436792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:13.451069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 200/387] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:13.456747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:13.459384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:13.460382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:13.460860 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:13.461386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:13.462388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:13.462950 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:13.464649 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:13.478560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 188/388] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:13.480901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:13.605899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fb5b3-3250-44dc-b090-546ed7cce71d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:13.641865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed64e4-5e0a-4db0-86f5-bdac88f5a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:13.643108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed64e4-5e0a-4db0-86f5-bdac88f5a675 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:13.643603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed64e4-5e0a-4db0-86f5-bdac88f5a675 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:13.644087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed64e4-5e0a-4db0-86f5-bdac88f5a675 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:13.645526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed64e4-5e0a-4db0-86f5-bdac88f5a675 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:13.647164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed64e4-5e0a-4db0-86f5-bdac88f5a675 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:13.651838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 189/389] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:13 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:13.655016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed64e4-5e0a-4db0-86f5-bdac88f5a675 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:13.683049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511875e-8734-48fe-88de-318d847b0d2b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:13.758276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed64e4-5e0a-4db0-86f5-bdac88f5a675 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:13.760562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dfd53-bb0c-4fee-b673-4613b45ab381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:13.761854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dfd53-bb0c-4fee-b673-4613b45ab381 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:13.761854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dfd53-bb0c-4fee-b673-4613b45ab381 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:13.762041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dfd53-bb0c-4fee-b673-4613b45ab381 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:13.763972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dfd53-bb0c-4fee-b673-4613b45ab381 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:13.765417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dfd53-bb0c-4fee-b673-4613b45ab381 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:13.767342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 201/390] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:13 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:13.772753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dfd53-bb0c-4fee-b673-4613b45ab381 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:13.795995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045563-4e5c-4aee-a854-d0bbd3316c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:13.797216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045563-4e5c-4aee-a854-d0bbd3316c6b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:13.797753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045563-4e5c-4aee-a854-d0bbd3316c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:13.798222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045563-4e5c-4aee-a854-d0bbd3316c6b None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:13.799674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0045563-4e5c-4aee-a854-d0bbd3316c6b None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:13.801301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0045563-4e5c-4aee-a854-d0bbd3316c6b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:13.807652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 190/391] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:13 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:13.809417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045563-4e5c-4aee-a854-d0bbd3316c6b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:13.911095 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045563-4e5c-4aee-a854-d0bbd3316c6b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:13.946362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da66f5-0353-47eb-b440-a656bbc38be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:13.947686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da66f5-0353-47eb-b440-a656bbc38be5 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:13.948191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da66f5-0353-47eb-b440-a656bbc38be5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:13.948686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da66f5-0353-47eb-b440-a656bbc38be5 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840/groups/b94937ed951c4ba3b651d68a79716ddf/roles/b522cd7d0a2e4208bd451e2a39c97d63` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:13.951105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da66f5-0353-47eb-b440-a656bbc38be5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd89398693a247abb18b91b7cd6b5840, group_id=b94937ed951c4ba3b651d68a79716ddf, role_id=b522cd7d0a2e4208bd451e2a39c97d63)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:13.952874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da66f5-0353-47eb-b440-a656bbc38be5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:13.983895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 191/392] 10.222.0.93 () {58 vars in 1442 bytes} [Wed May 11 18:44:13 2022] PUT /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840/groups/b94937ed951c4ba3b651d68a79716ddf/roles/b522cd7d0a2e4208bd451e2a39c97d63 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:44:13.997381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dfd53-bb0c-4fee-b673-4613b45ab381 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:14.040022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d71537-cf93-40d2-8b83-d8ad11125eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:14.041711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71537-cf93-40d2-8b83-d8ad11125eed None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:14.042264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71537-cf93-40d2-8b83-d8ad11125eed None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:14.042753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71537-cf93-40d2-8b83-d8ad11125eed None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:14.044304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d71537-cf93-40d2-8b83-d8ad11125eed None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:14.046095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d71537-cf93-40d2-8b83-d8ad11125eed None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:14.048575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 202/393] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:13 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:14.055378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da66f5-0353-47eb-b440-a656bbc38be5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:14.171541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da66f5-0353-47eb-b440-a656bbc38be5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:14.209400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9c2f4-64b5-46c1-97c1-5cf184464631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:14.211352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c2f4-64b5-46c1-97c1-5cf184464631 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:14.211352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c2f4-64b5-46c1-97c1-5cf184464631 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:14.211352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c2f4-64b5-46c1-97c1-5cf184464631 None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840/groups/b94937ed951c4ba3b651d68a79716ddf/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:14.212980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9c2f4-64b5-46c1-97c1-5cf184464631 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd89398693a247abb18b91b7cd6b5840, group_id=b94937ed951c4ba3b651d68a79716ddf, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:14.214575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9c2f4-64b5-46c1-97c1-5cf184464631 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:14.232096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 192/394] 10.222.0.93 () {58 vars in 1442 bytes} [Wed May 11 18:44:14 2022] PUT /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840/groups/b94937ed951c4ba3b651d68a79716ddf/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:14.518592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d1fca-16f2-49e0-9e71-3742d7818bb9 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:14.518780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d1fca-16f2-49e0-9e71-3742d7818bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:14.519053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d1fca-16f2-49e0-9e71-3742d7818bb9 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:14.521119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 203/395] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:14.526907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79e79-f26b-4cbf-a93e-0fcd0a49f529 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:14.527191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79e79-f26b-4cbf-a93e-0fcd0a49f529 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:14.527497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79e79-f26b-4cbf-a93e-0fcd0a49f529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:14.549310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-53a79e79-f26b-4cbf-a93e-0fcd0a49f529 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:14.550503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-53a79e79-f26b-4cbf-a93e-0fcd0a49f529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:14.627151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 193/396] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:14.654526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d1fca-16f2-49e0-9e71-3742d7818bb9 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:14.747965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bf3d-0aab-446f-ac48-899b0fde7ce9 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:14.748283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bf3d-0aab-446f-ac48-899b0fde7ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:14.748615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7bf3d-0aab-446f-ac48-899b0fde7ce9 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:14.749984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 194/397] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:44:14.757112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebea34-228b-41c0-8d28-b3a7ecaf5b2e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:14.757395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebea34-228b-41c0-8d28-b3a7ecaf5b2e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:14.759031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebea34-228b-41c0-8d28-b3a7ecaf5b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:14.783526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-aaebea34-228b-41c0-8d28-b3a7ecaf5b2e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:14.785161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-aaebea34-228b-41c0-8d28-b3a7ecaf5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:14.800970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d1fca-16f2-49e0-9e71-3742d7818bb9 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:14.863976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 195/398] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:14.873329 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abc13a-d7d5-4106-93b4-6a17af263e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:14.874199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abc13a-d7d5-4106-93b4-6a17af263e3a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:14.874475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abc13a-d7d5-4106-93b4-6a17af263e3a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:14.874795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abc13a-d7d5-4106-93b4-6a17af263e3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:14.885703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abc13a-d7d5-4106-93b4-6a17af263e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-59abc13a-d7d5-4106-93b4-6a17af263e3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:14.893586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:14.894492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:14.895256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 204/399] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:14.901702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebea34-228b-41c0-8d28-b3a7ecaf5b2e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:14.941087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abc13a-d7d5-4106-93b4-6a17af263e3a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.068109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abc13a-d7d5-4106-93b4-6a17af263e3a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.101238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebea34-228b-41c0-8d28-b3a7ecaf5b2e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.112218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900058f-ba21-4949-bae7-87b15896fe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.113041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900058f-ba21-4949-bae7-87b15896fe5a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.113321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900058f-ba21-4949-bae7-87b15896fe5a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.113594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900058f-ba21-4949-bae7-87b15896fe5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.136379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900058f-ba21-4949-bae7-87b15896fe5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-0900058f-ba21-4949-bae7-87b15896fe5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:15.146765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:15.147689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:15.148478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:15.153025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 205/400] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:44:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:15.154346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900058f-ba21-4949-bae7-87b15896fe5a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.209548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.209548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.209548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.209548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.209995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] RBAC: Adding query filter params (name=member) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:15.210252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:15.211650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:15.230855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 196/401] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:15.236198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.270243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900058f-ba21-4949-bae7-87b15896fe5a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.312916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.313588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.313868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.314141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.315149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:15.315482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:15.316867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:15.331459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 206/402] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:15.335093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.346580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473a202-90de-4cbc-892a-9ad8cc208dce None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.406450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2d33-417b-40ad-bb28-618e5066a206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.407399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2d33-417b-40ad-bb28-618e5066a206 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.407674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2d33-417b-40ad-bb28-618e5066a206 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.407947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2d33-417b-40ad-bb28-618e5066a206 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.409795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf2d33-417b-40ad-bb28-618e5066a206 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:15.413544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf2d33-417b-40ad-bb28-618e5066a206 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:15.418718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 197/403] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:15 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:15.428472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2d33-417b-40ad-bb28-618e5066a206 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.508877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b91ec-73c8-4d94-a517-d11c04ef7318 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.563572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176016b-49a1-4682-a5f8-768a7248ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.564440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176016b-49a1-4682-a5f8-768a7248ff1e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.564714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176016b-49a1-4682-a5f8-768a7248ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.565236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176016b-49a1-4682-a5f8-768a7248ff1e None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.567915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176016b-49a1-4682-a5f8-768a7248ff1e None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:15.574563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176016b-49a1-4682-a5f8-768a7248ff1e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:15.576338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 207/404] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:15 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:15.582111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176016b-49a1-4682-a5f8-768a7248ff1e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.630386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2d33-417b-40ad-bb28-618e5066a206 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.681746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced019-59ff-4209-842a-d8551e713948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.682604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced019-59ff-4209-842a-d8551e713948 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.682876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced019-59ff-4209-842a-d8551e713948 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.683141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced019-59ff-4209-842a-d8551e713948 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.684461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced019-59ff-4209-842a-d8551e713948 None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:15.685892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced019-59ff-4209-842a-d8551e713948 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:15.687711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 198/405] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:15 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:15.688861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30351-af51-4d20-a2b1-5e78d03d329f None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.689145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30351-af51-4d20-a2b1-5e78d03d329f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.689411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30351-af51-4d20-a2b1-5e78d03d329f None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.691102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 199/406] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:15.696338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606da2-eadc-4484-8b22-c0aeb12ef770 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.696613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606da2-eadc-4484-8b22-c0aeb12ef770 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.696880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606da2-eadc-4484-8b22-c0aeb12ef770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.718773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d2606da2-eadc-4484-8b22-c0aeb12ef770 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:15.720045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d2606da2-eadc-4484-8b22-c0aeb12ef770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:15.731996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176016b-49a1-4682-a5f8-768a7248ff1e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.767079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9374-ba23-4a7d-a42b-362bc80c122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.768227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9374-ba23-4a7d-a42b-362bc80c122a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.768649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9374-ba23-4a7d-a42b-362bc80c122a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.769059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9374-ba23-4a7d-a42b-362bc80c122a None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.770458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9374-ba23-4a7d-a42b-362bc80c122a None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:15.772069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9374-ba23-4a7d-a42b-362bc80c122a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:15.778563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 208/407] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:15 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:15.779531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9374-ba23-4a7d-a42b-362bc80c122a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.793134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 200/408] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:15.794251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2606da2-eadc-4484-8b22-c0aeb12ef770 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.882702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9374-ba23-4a7d-a42b-362bc80c122a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.897228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2606da2-eadc-4484-8b22-c0aeb12ef770 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:15.918101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae0a5a-9599-4e5b-919d-78e9df697997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.918709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae0a5a-9599-4e5b-919d-78e9df697997 None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.918994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae0a5a-9599-4e5b-919d-78e9df697997 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.919271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae0a5a-9599-4e5b-919d-78e9df697997 None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60/groups/b94937ed951c4ba3b651d68a79716ddf/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.921283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae0a5a-9599-4e5b-919d-78e9df697997 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0730edd303b4a70a18988aaf37dbc60, group_id=b94937ed951c4ba3b651d68a79716ddf, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:15.922740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae0a5a-9599-4e5b-919d-78e9df697997 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:15.935566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48936111-7371-4443-900b-831e200d903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:15.936693 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936111-7371-4443-900b-831e200d903d None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:15.937109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936111-7371-4443-900b-831e200d903d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:15.937511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936111-7371-4443-900b-831e200d903d None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60/groups/b94937ed951c4ba3b651d68a79716ddf/roles/b522cd7d0a2e4208bd451e2a39c97d63` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:15.940300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48936111-7371-4443-900b-831e200d903d None admin] RBAC: Authorizing `identity:create_grant(project_id=f0730edd303b4a70a18988aaf37dbc60, group_id=b94937ed951c4ba3b651d68a79716ddf, role_id=b522cd7d0a2e4208bd451e2a39c97d63)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:15.941957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48936111-7371-4443-900b-831e200d903d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:15.951632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 209/409] 10.222.0.93 () {58 vars in 1442 bytes} [Wed May 11 18:44:15 2022] PUT /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60/groups/b94937ed951c4ba3b651d68a79716ddf/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:15.952912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae0a5a-9599-4e5b-919d-78e9df697997 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:15.960628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 201/410] 10.222.0.93 () {58 vars in 1442 bytes} [Wed May 11 18:44:15 2022] PUT /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60/groups/b94937ed951c4ba3b651d68a79716ddf/roles/b522cd7d0a2e4208bd451e2a39c97d63 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:16.074143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae0a5a-9599-4e5b-919d-78e9df697997 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:16.117465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc3761-1bb2-4560-a6c6-f4535cca049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:16.118574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc3761-1bb2-4560-a6c6-f4535cca049e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:16.119059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc3761-1bb2-4560-a6c6-f4535cca049e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:16.119528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc3761-1bb2-4560-a6c6-f4535cca049e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:16.137546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc3761-1bb2-4560-a6c6-f4535cca049e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-c1dc3761-1bb2-4560-a6c6-f4535cca049e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:16.146146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:16.147177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:16.149207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:16.151634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 210/411] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:16.157234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48936111-7371-4443-900b-831e200d903d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:16.300513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48936111-7371-4443-900b-831e200d903d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:16.342350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:16.343034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:16.343326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:16.343608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:16.344360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:16.344663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:16.346024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:16.355168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 202/412] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:16.360709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc3761-1bb2-4560-a6c6-f4535cca049e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:16.482641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc3761-1bb2-4560-a6c6-f4535cca049e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:16.521488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec10c-17d8-46e3-924e-b948d1d8c291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:16.522356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec10c-17d8-46e3-924e-b948d1d8c291 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:16.522630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec10c-17d8-46e3-924e-b948d1d8c291 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:16.522896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec10c-17d8-46e3-924e-b948d1d8c291 None admin] PATH_INFO: `/v3/groups/c5afb7a655114f12b656b366098fa38e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:16.524096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ec10c-17d8-46e3-924e-b948d1d8c291 None admin] RBAC: Authorizing `identity:get_group(group_id=c5afb7a655114f12b656b366098fa38e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:16.525530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ec10c-17d8-46e3-924e-b948d1d8c291 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:16.527125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 211/413] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:16 2022] GET /identity/v3/groups/c5afb7a655114f12b656b366098fa38e => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:16.532840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:16.637381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6f29-c3f8-4378-bb1f-02aac7e0e714 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:16.674306 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d581ab-e435-4b13-81da-d140d5b62d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:16.675166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d581ab-e435-4b13-81da-d140d5b62d26 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:16.675466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d581ab-e435-4b13-81da-d140d5b62d26 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:16.675734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d581ab-e435-4b13-81da-d140d5b62d26 None admin] PATH_INFO: `/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:16.680007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d581ab-e435-4b13-81da-d140d5b62d26 None admin] RBAC: Authorizing `identity:get_project(project_id=639dcabe7cb941cc82eb0b4e6f620fd4)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:16.681434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d581ab-e435-4b13-81da-d140d5b62d26 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:16.683164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 203/414] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:16 2022] GET /identity/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:16.689031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec10c-17d8-46e3-924e-b948d1d8c291 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:16.799998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec10c-17d8-46e3-924e-b948d1d8c291 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:16.849439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebdb1c-d999-4a3c-a0a1-818c68c852fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:16.850329 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdb1c-d999-4a3c-a0a1-818c68c852fc None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:16.850606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdb1c-d999-4a3c-a0a1-818c68c852fc None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:16.850876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdb1c-d999-4a3c-a0a1-818c68c852fc None admin] PATH_INFO: `/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4/groups/c5afb7a655114f12b656b366098fa38e/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:16.852894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebdb1c-d999-4a3c-a0a1-818c68c852fc None admin] RBAC: Authorizing `identity:create_grant(project_id=639dcabe7cb941cc82eb0b4e6f620fd4, group_id=c5afb7a655114f12b656b366098fa38e, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:16.854353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebdb1c-d999-4a3c-a0a1-818c68c852fc None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:16.873681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 212/415] 10.222.0.93 () {58 vars in 1442 bytes} [Wed May 11 18:44:16 2022] PUT /identity/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4/groups/c5afb7a655114f12b656b366098fa38e/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:17.002758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2035f-6d57-425f-8c36-046a6cadac5f None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:17.003104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2035f-6d57-425f-8c36-046a6cadac5f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:17.003322 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2035f-6d57-425f-8c36-046a6cadac5f None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:17.005376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 204/416] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:17.021736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994617bf-a3f3-4d2c-b3ab-f61e5772896f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:17.022081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994617bf-a3f3-4d2c-b3ab-f61e5772896f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:17.022295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994617bf-a3f3-4d2c-b3ab-f61e5772896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:17.045529 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-994617bf-a3f3-4d2c-b3ab-f61e5772896f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:17.046792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-994617bf-a3f3-4d2c-b3ab-f61e5772896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:17.131111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 213/417] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:17.156315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2035f-6d57-425f-8c36-046a6cadac5f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:17.268754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded572-f539-4bb7-a100-c6316fc8e503 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:17.269085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded572-f539-4bb7-a100-c6316fc8e503 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:17.269301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded572-f539-4bb7-a100-c6316fc8e503 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:17.271886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 214/418] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:44:17.278010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99184-175b-4174-8dee-6606f816f331 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:17.278307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99184-175b-4174-8dee-6606f816f331 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:17.278649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99184-175b-4174-8dee-6606f816f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:17.302881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2035f-6d57-425f-8c36-046a6cadac5f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:17.311893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-15d99184-175b-4174-8dee-6606f816f331 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:17.313358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-15d99184-175b-4174-8dee-6606f816f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:17.363152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2270a-a961-4e1a-a723-9fb5fd77ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:17.365538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2270a-a961-4e1a-a723-9fb5fd77ffad None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:17.366045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2270a-a961-4e1a-a723-9fb5fd77ffad None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:17.366687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2270a-a961-4e1a-a723-9fb5fd77ffad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:17.384928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2270a-a961-4e1a-a723-9fb5fd77ffad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-62a2270a-a961-4e1a-a723-9fb5fd77ffad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:17.393724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:17.394598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:17.395936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:17.399707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 205/419] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:17.406228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2270a-a961-4e1a-a723-9fb5fd77ffad None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:17.450583 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 215/420] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:17.542176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99184-175b-4174-8dee-6606f816f331 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:17.545848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2270a-a961-4e1a-a723-9fb5fd77ffad None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:17.620851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:17.621533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:17.621817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:17.622091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:17.622848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:17.623157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:17.624557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:17.641123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 206/421] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:17.649156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:17.726447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99184-175b-4174-8dee-6606f816f331 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:17.770014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c871e7-543c-490c-894d-14c3a3abba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:17.771829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c871e7-543c-490c-894d-14c3a3abba47 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:17.772314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c871e7-543c-490c-894d-14c3a3abba47 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:17.772943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c871e7-543c-490c-894d-14c3a3abba47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:17.785613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c871e7-543c-490c-894d-14c3a3abba47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-50c871e7-543c-490c-894d-14c3a3abba47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:17.804436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:17.805359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:17.806171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:17.808660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 216/422] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:17.814630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c871e7-543c-490c-894d-14c3a3abba47 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:17.850007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bd25c-e5e7-49ea-b9f2-23f556c460f6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:17.924005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb4e7b-ca25-40f7-9559-bb326f6788d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:17.924673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4e7b-ca25-40f7-9559-bb326f6788d8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:17.924956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4e7b-ca25-40f7-9559-bb326f6788d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:17.925230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4e7b-ca25-40f7-9559-bb326f6788d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:17.962419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c871e7-543c-490c-894d-14c3a3abba47 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:17.999649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:18.000819 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:18.001305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:18.001778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:18.002731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] RBAC: Adding query filter params (name=member) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:18.003321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:18.005661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:18.015986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 217/423] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:18.022633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:18.075460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb4e7b-ca25-40f7-9559-bb326f6788d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:18.077614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb4e7b-ca25-40f7-9559-bb326f6788d8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:18.225142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 207/424] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:18.230675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb4e7b-ca25-40f7-9559-bb326f6788d8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:18.241990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882150e7-cd11-46b4-ab8c-19c6eb858a5a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:18.340586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67e7eb-1080-4c53-87f2-a02dc977260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:18.341250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67e7eb-1080-4c53-87f2-a02dc977260c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:18.341528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67e7eb-1080-4c53-87f2-a02dc977260c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:18.341798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67e7eb-1080-4c53-87f2-a02dc977260c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:18.350561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb4e7b-ca25-40f7-9559-bb326f6788d8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:18.391807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d538-be94-4b85-819d-e8e16c22e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:18.392668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d538-be94-4b85-819d-e8e16c22e06a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:18.392945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d538-be94-4b85-819d-e8e16c22e06a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:18.393217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d538-be94-4b85-819d-e8e16c22e06a None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:18.398000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6d538-be94-4b85-819d-e8e16c22e06a None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:18.399478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6d538-be94-4b85-819d-e8e16c22e06a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:18.410104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 208/425] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:18 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:18.413088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d538-be94-4b85-819d-e8e16c22e06a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:18.496926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67e7eb-1080-4c53-87f2-a02dc977260c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:18.498315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67e7eb-1080-4c53-87f2-a02dc977260c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:18.632483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 218/426] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:18.638270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67e7eb-1080-4c53-87f2-a02dc977260c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:18.666032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d538-be94-4b85-819d-e8e16c22e06a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:18.733030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd78bc-950b-4fef-8c93-1948b74f454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:18.734139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd78bc-950b-4fef-8c93-1948b74f454c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:18.734567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd78bc-950b-4fef-8c93-1948b74f454c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:18.735009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd78bc-950b-4fef-8c93-1948b74f454c None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:18.736362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd78bc-950b-4fef-8c93-1948b74f454c None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:18.737953 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd78bc-950b-4fef-8c93-1948b74f454c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:18.740622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 209/427] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:18 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:18.742054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c03b-4847-47a8-a4f7-446688b92c1c None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:18.742506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c03b-4847-47a8-a4f7-446688b92c1c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:18.742927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c03b-4847-47a8-a4f7-446688b92c1c None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:18.744329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 210/428] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:18.748449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67e7eb-1080-4c53-87f2-a02dc977260c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:18.749351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c03b-4847-47a8-a4f7-446688b92c1c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:18.791451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8ffdd-f811-46ba-a698-50094817fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:18.792685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ffdd-f811-46ba-a698-50094817fe9c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:18.792972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ffdd-f811-46ba-a698-50094817fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:18.793247 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ffdd-f811-46ba-a698-50094817fe9c None admin] PATH_INFO: `/v3/projects/fd89398693a247abb18b91b7cd6b5840` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:18.794783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8ffdd-f811-46ba-a698-50094817fe9c None admin] RBAC: Authorizing `identity:get_project(project_id=fd89398693a247abb18b91b7cd6b5840)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:18.796731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8ffdd-f811-46ba-a698-50094817fe9c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:18.799471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 219/429] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:18 2022] GET /identity/v3/projects/fd89398693a247abb18b91b7cd6b5840 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:18.803993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac054b-9ad8-467d-8a8f-ffef4a4f2185 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:18.805445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac054b-9ad8-467d-8a8f-ffef4a4f2185 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:18.807683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac054b-9ad8-467d-8a8f-ffef4a4f2185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:18.830491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-67ac054b-9ad8-467d-8a8f-ffef4a4f2185 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:18.831764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-67ac054b-9ad8-467d-8a8f-ffef4a4f2185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:18.863153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c03b-4847-47a8-a4f7-446688b92c1c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:18.899838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:18.900812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:18.901293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:18.901735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:18.902805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] RBAC: Adding query filter params (group.id=b94937ed951c4ba3b651d68a79716ddf, role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=fd89398693a247abb18b91b7cd6b5840) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:18.903320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:18.904917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:18.912263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 211/430] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:18 2022] GET /identity/v3/role_assignments?group.id=b94937ed951c4ba3b651d68a79716ddf&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:18.913399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:18.923339 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 220/431] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:18.962011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac054b-9ad8-467d-8a8f-ffef4a4f2185 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:19.097623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac054b-9ad8-467d-8a8f-ffef4a4f2185 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.101002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9656785-109a-4071-bef4-46180be6f4c5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.135332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f09eb-a647-43ba-8667-b155319675fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.136328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f09eb-a647-43ba-8667-b155319675fb None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.136609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f09eb-a647-43ba-8667-b155319675fb None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.137178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f09eb-a647-43ba-8667-b155319675fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.145992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382f6b-d97f-42fc-b5bf-bd085ece54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.147467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382f6b-d97f-42fc-b5bf-bd085ece54e3 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.147916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382f6b-d97f-42fc-b5bf-bd085ece54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.148391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382f6b-d97f-42fc-b5bf-bd085ece54e3 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.149582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf382f6b-d97f-42fc-b5bf-bd085ece54e3 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:19.150682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f09eb-a647-43ba-8667-b155319675fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:19.151028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf382f6b-d97f-42fc-b5bf-bd085ece54e3 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:19.153580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 212/432] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:18 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:19.154977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db4b0-6691-46fe-bd41-c24529ce5e8b None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.155255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db4b0-6691-46fe-bd41-c24529ce5e8b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.155552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db4b0-6691-46fe-bd41-c24529ce5e8b None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-386f09eb-a647-43ba-8667-b155319675fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:19.159159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:19.160130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:19.160980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:19.161630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 213/434] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:19.162171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3db4b0-6691-46fe-bd41-c24529ce5e8b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:19.165502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 221/434] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:44:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:19.166961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e33d7-4e72-4dad-8852-51b1dd37e33d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.167245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e33d7-4e72-4dad-8852-51b1dd37e33d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.167561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e33d7-4e72-4dad-8852-51b1dd37e33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.186661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-701e33d7-4e72-4dad-8852-51b1dd37e33d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:19.187518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-701e33d7-4e72-4dad-8852-51b1dd37e33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:19.279325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 222/435] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:19.279325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e33d7-4e72-4dad-8852-51b1dd37e33d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:19.289792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3db4b0-6691-46fe-bd41-c24529ce5e8b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.323115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.323809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.324084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.324355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.325167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] RBAC: Adding query filter params (group.id=b94937ed951c4ba3b651d68a79716ddf, role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=fd89398693a247abb18b91b7cd6b5840) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:19.325478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:19.326898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:19.332814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 214/436] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:19 2022] GET /identity/v3/role_assignments?group.id=b94937ed951c4ba3b651d68a79716ddf&scope.project.id=fd89398693a247abb18b91b7cd6b5840&role.id=39757d16971a48b6836913cd1908f48e => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:19.343619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:19.410343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e33d7-4e72-4dad-8852-51b1dd37e33d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.454954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef9b48-22d2-473a-b7cb-f950ec0f0aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.455665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9b48-22d2-473a-b7cb-f950ec0f0aa0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.455942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9b48-22d2-473a-b7cb-f950ec0f0aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.456210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9b48-22d2-473a-b7cb-f950ec0f0aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.456958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef9b48-22d2-473a-b7cb-f950ec0f0aa0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:19.457262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef9b48-22d2-473a-b7cb-f950ec0f0aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:19.459180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef9b48-22d2-473a-b7cb-f950ec0f0aa0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:19.463734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b32d3a-b89e-431d-b4b2-c8d00004238f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.468066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 223/437] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:19.469381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c87d-9e60-4883-a94e-32dd682351d4 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.469671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c87d-9e60-4883-a94e-32dd682351d4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.469941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c87d-9e60-4883-a94e-32dd682351d4 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.475432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 224/438] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:19.475432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826c87d-9e60-4883-a94e-32dd682351d4 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:19.508966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd3063-3841-41cc-b0af-7fd7f95c4b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.510057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3063-3841-41cc-b0af-7fd7f95c4b1e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.510338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3063-3841-41cc-b0af-7fd7f95c4b1e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.510609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3063-3841-41cc-b0af-7fd7f95c4b1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.524354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd3063-3841-41cc-b0af-7fd7f95c4b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-29bd3063-3841-41cc-b0af-7fd7f95c4b1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:19.532181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:19.533046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:19.533844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 215/439] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:19.534661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39641cd-81c8-401d-9264-fce3e6a2b452 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.534984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39641cd-81c8-401d-9264-fce3e6a2b452 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.535217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39641cd-81c8-401d-9264-fce3e6a2b452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.555834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a39641cd-81c8-401d-9264-fce3e6a2b452 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:19.557045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a39641cd-81c8-401d-9264-fce3e6a2b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:19.589579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826c87d-9e60-4883-a94e-32dd682351d4 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.627107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666b6ca-e759-45a8-a2a5-ed9a24056a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.628105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b6ca-e759-45a8-a2a5-ed9a24056a05 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.631342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b6ca-e759-45a8-a2a5-ed9a24056a05 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.631342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b6ca-e759-45a8-a2a5-ed9a24056a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.641892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 216/440] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:19.642738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39641cd-81c8-401d-9264-fce3e6a2b452 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:19.710858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666b6ca-e759-45a8-a2a5-ed9a24056a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:19.712280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666b6ca-e759-45a8-a2a5-ed9a24056a05 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:19.751097 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39641cd-81c8-401d-9264-fce3e6a2b452 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.792110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.792772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.793046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.793311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.794054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] RBAC: Adding query filter params (name=member) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:19.794354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:19.795784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:19.805342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 217/441] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:44:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:19.806175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:19.828979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 225/442] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:19.830133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666b6ca-e759-45a8-a2a5-ed9a24056a05 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:19.916621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb76752-35dd-40d6-a229-6bbf57c5613a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.931938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666b6ca-e759-45a8-a2a5-ed9a24056a05 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:19.948668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fbc8a-7c17-4260-b114-d34ff266e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.949458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fbc8a-7c17-4260-b114-d34ff266e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.949737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fbc8a-7c17-4260-b114-d34ff266e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.950009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fbc8a-7c17-4260-b114-d34ff266e7e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.959917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fbc8a-7c17-4260-b114-d34ff266e7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:19.963635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde7754-7f97-4920-bec5-7f0301e5b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:19.964224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7754-7f97-4920-bec5-7f0301e5b249 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:19.964505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7754-7f97-4920-bec5-7f0301e5b249 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:19.964778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7754-7f97-4920-bec5-7f0301e5b249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-e66fbc8a-7c17-4260-b114-d34ff266e7e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:19.967612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:19.968447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 218/443] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:19.974572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fbc8a-7c17-4260-b114-d34ff266e7e5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.029543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde7754-7f97-4920-bec5-7f0301e5b249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.031008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde7754-7f97-4920-bec5-7f0301e5b249 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.064588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fbc8a-7c17-4260-b114-d34ff266e7e5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.096124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a8ba6-6191-4cdd-9455-44fec1c7766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.097112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8ba6-6191-4cdd-9455-44fec1c7766d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.097400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8ba6-6191-4cdd-9455-44fec1c7766d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.097678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8ba6-6191-4cdd-9455-44fec1c7766d None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.099383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a8ba6-6191-4cdd-9455-44fec1c7766d None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.100839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a8ba6-6191-4cdd-9455-44fec1c7766d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.102531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 219/444] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:19 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:20.103365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a8ba6-6191-4cdd-9455-44fec1c7766d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.127173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 226/445] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:20.128045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde7754-7f97-4920-bec5-7f0301e5b249 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.203972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a8ba6-6191-4cdd-9455-44fec1c7766d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.220127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde7754-7f97-4920-bec5-7f0301e5b249 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.235906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.236563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.236845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.237121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.237863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:20.238168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.240082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.247843 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 220/446] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:20.248623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.255166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505e762-0df3-449d-a15c-9fcf7c21447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.256079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e762-0df3-449d-a15c-9fcf7c21447e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.256362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e762-0df3-449d-a15c-9fcf7c21447e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.256634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505e762-0df3-449d-a15c-9fcf7c21447e None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.257808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505e762-0df3-449d-a15c-9fcf7c21447e None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.259263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505e762-0df3-449d-a15c-9fcf7c21447e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.260902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 227/447] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:20.261658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505e762-0df3-449d-a15c-9fcf7c21447e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.349162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f815d4-49a7-4054-9147-de94816f9e9a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.363269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505e762-0df3-449d-a15c-9fcf7c21447e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.381705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fdd79-23ea-4de7-93bb-5848159eb2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.382552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdd79-23ea-4de7-93bb-5848159eb2ee None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.382825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdd79-23ea-4de7-93bb-5848159eb2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.383092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdd79-23ea-4de7-93bb-5848159eb2ee None admin] PATH_INFO: `/v3/projects/f0730edd303b4a70a18988aaf37dbc60` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.384300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fdd79-23ea-4de7-93bb-5848159eb2ee None admin] RBAC: Authorizing `identity:get_project(project_id=f0730edd303b4a70a18988aaf37dbc60)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.385714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fdd79-23ea-4de7-93bb-5848159eb2ee None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.387403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 221/448] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/projects/f0730edd303b4a70a18988aaf37dbc60 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:20.388144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fdd79-23ea-4de7-93bb-5848159eb2ee None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.401194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c34ad2-34e8-4103-9d63-92c8e9124efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.401836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34ad2-34e8-4103-9d63-92c8e9124efd None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.402113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34ad2-34e8-4103-9d63-92c8e9124efd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.402384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34ad2-34e8-4103-9d63-92c8e9124efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.466319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c34ad2-34e8-4103-9d63-92c8e9124efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.467827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c34ad2-34e8-4103-9d63-92c8e9124efd None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.481681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fdd79-23ea-4de7-93bb-5848159eb2ee None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.512678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.513320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.513602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.513873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.514702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] RBAC: Adding query filter params (group.id=b94937ed951c4ba3b651d68a79716ddf, role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=f0730edd303b4a70a18988aaf37dbc60) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:20.515013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.516480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.531608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 222/449] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/role_assignments?group.id=b94937ed951c4ba3b651d68a79716ddf&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:20.531608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.565274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 228/450] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:20.571878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c34ad2-34e8-4103-9d63-92c8e9124efd None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.639116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6190dad-98e9-4b26-8f82-7e26df879660 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.673588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c34ad2-34e8-4103-9d63-92c8e9124efd None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.674494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200d0a-ae7b-4685-8e2f-35cce5903536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.675452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200d0a-ae7b-4685-8e2f-35cce5903536 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.675726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200d0a-ae7b-4685-8e2f-35cce5903536 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.675990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200d0a-ae7b-4685-8e2f-35cce5903536 None admin] PATH_INFO: `/v3/groups/b94937ed951c4ba3b651d68a79716ddf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.677759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200d0a-ae7b-4685-8e2f-35cce5903536 None admin] RBAC: Authorizing `identity:get_group(group_id=b94937ed951c4ba3b651d68a79716ddf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.679217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200d0a-ae7b-4685-8e2f-35cce5903536 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.681106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 223/451] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/groups/b94937ed951c4ba3b651d68a79716ddf => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:20.686967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200d0a-ae7b-4685-8e2f-35cce5903536 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.711195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76bde4-f0eb-45c5-a847-c844dd98be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.712092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76bde4-f0eb-45c5-a847-c844dd98be36 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.712374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76bde4-f0eb-45c5-a847-c844dd98be36 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.712646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76bde4-f0eb-45c5-a847-c844dd98be36 None admin] PATH_INFO: `/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.713924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76bde4-f0eb-45c5-a847-c844dd98be36 None admin] RBAC: Authorizing `identity:get_project(project_id=639dcabe7cb941cc82eb0b4e6f620fd4)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.715369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76bde4-f0eb-45c5-a847-c844dd98be36 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.717222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 229/452] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/projects/639dcabe7cb941cc82eb0b4e6f620fd4 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:20.722357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76bde4-f0eb-45c5-a847-c844dd98be36 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.793234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200d0a-ae7b-4685-8e2f-35cce5903536 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.822228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76bde4-f0eb-45c5-a847-c844dd98be36 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:20.824915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.825569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.825850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.826142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.826962 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] RBAC: Adding query filter params (group.id=b94937ed951c4ba3b651d68a79716ddf, role.id=39757d16971a48b6836913cd1908f48e, scope.project.id=f0730edd303b4a70a18988aaf37dbc60) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:20.827275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.828756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.835145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 224/453] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/role_assignments?group.id=b94937ed951c4ba3b651d68a79716ddf&scope.project.id=f0730edd303b4a70a18988aaf37dbc60&role.id=39757d16971a48b6836913cd1908f48e => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:20.855380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be564a5-c828-4d6d-9f2a-320ac53ec78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:20.856262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be564a5-c828-4d6d-9f2a-320ac53ec78c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:20.856535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be564a5-c828-4d6d-9f2a-320ac53ec78c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:20.856803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be564a5-c828-4d6d-9f2a-320ac53ec78c None admin] PATH_INFO: `/v3/groups/c5afb7a655114f12b656b366098fa38e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:20.858042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be564a5-c828-4d6d-9f2a-320ac53ec78c None admin] RBAC: Authorizing `identity:get_group(group_id=c5afb7a655114f12b656b366098fa38e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:20.859543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be564a5-c828-4d6d-9f2a-320ac53ec78c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:20.861234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 230/454] 10.222.0.93 () {56 vars in 1180 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/groups/c5afb7a655114f12b656b366098fa38e => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:20.867514 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:20.970206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ac19c-167a-4b67-9911-66effff3ac38 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:21.004235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba37776-455e-44f3-bceb-fb72a34c34da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:21.006158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba37776-455e-44f3-bceb-fb72a34c34da None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:21.006439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba37776-455e-44f3-bceb-fb72a34c34da None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:21.006712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba37776-455e-44f3-bceb-fb72a34c34da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:21.007578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba37776-455e-44f3-bceb-fb72a34c34da None admin] RBAC: Adding query filter params (group.id=c5afb7a655114f12b656b366098fa38e, role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=639dcabe7cb941cc82eb0b4e6f620fd4) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:21.007891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba37776-455e-44f3-bceb-fb72a34c34da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:21.009338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba37776-455e-44f3-bceb-fb72a34c34da None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:21.015275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 225/455] 10.222.0.93 () {56 vars in 1376 bytes} [Wed May 11 18:44:20 2022] GET /identity/v3/role_assignments?group.id=c5afb7a655114f12b656b366098fa38e&scope.project.id=639dcabe7cb941cc82eb0b4e6f620fd4&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:23.937368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94dee2-10e9-4093-bece-8dd852bc11c3 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:23.937924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94dee2-10e9-4093-bece-8dd852bc11c3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:23.937924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94dee2-10e9-4093-bece-8dd852bc11c3 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:23.939523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 231/456] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:23.946216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed5fa-bcae-468a-afca-429785470b1d None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:23.947162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed5fa-bcae-468a-afca-429785470b1d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:23.947657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed5fa-bcae-468a-afca-429785470b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:23.954243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5667-43ac-4a99-83ff-e4f3b7c372fb None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:23.954867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5667-43ac-4a99-83ff-e4f3b7c372fb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:23.955379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5667-43ac-4a99-83ff-e4f3b7c372fb None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:23.957302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 232/457] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:23.963771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380d93-607d-4128-9323-059097f2eb77 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:23.964409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380d93-607d-4128-9323-059097f2eb77 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:23.964884 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380d93-607d-4128-9323-059097f2eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:23.970541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-173ed5fa-bcae-468a-afca-429785470b1d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:23.971766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-173ed5fa-bcae-468a-afca-429785470b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:24.001648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9d380d93-607d-4128-9323-059097f2eb77 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:24.002836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9d380d93-607d-4128-9323-059097f2eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:24.102101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 226/458] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:24.129974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 233/459] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:24.133858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9070d-b061-456c-8495-1f58a7ded132 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.134135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9070d-b061-456c-8495-1f58a7ded132 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.134583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9070d-b061-456c-8495-1f58a7ded132 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.136335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 227/460] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:24.141386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933073e9-e4b1-4628-95d1-89ef05d0a827 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.141681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933073e9-e4b1-4628-95d1-89ef05d0a827 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.141962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933073e9-e4b1-4628-95d1-89ef05d0a827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.149100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9070d-b061-456c-8495-1f58a7ded132 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.161089 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-933073e9-e4b1-4628-95d1-89ef05d0a827 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:24.162486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-933073e9-e4b1-4628-95d1-89ef05d0a827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:24.247457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 234/461] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:24.249234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933073e9-e4b1-4628-95d1-89ef05d0a827 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.277011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9070d-b061-456c-8495-1f58a7ded132 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.318029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:24.318990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.319410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.319787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.330188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:24.331762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:24.349840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:24.350748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:24.351822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:24.351822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:24.351822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:24.351822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:24.351822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 228/462] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:24.352767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.362468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933073e9-e4b1-4628-95d1-89ef05d0a827 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.398737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:24.399883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.400379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.400855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.411651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:24.413338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:24.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:24.432824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:24.433742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:24.433742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:24.433742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:24.433742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:24.436032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 235/463] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:24.437157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.452421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86cc85-f480-4142-905a-6141bca81584 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.492765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:24.493560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.493837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.494104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.505518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:24.507069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:24.525227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:24.526112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:24.526947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:24.526947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:24.526947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:24.526947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:24.531329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 229/464] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:24.532226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.566271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185ca4-210c-4db5-823c-24b1b8622077 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.609738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:24.610756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.611641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.612128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.613374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:24.614118 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:24.615890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:24.629202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 236/465] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:24.630785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.640455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399f4ee-7308-4a5f-965e-7059928a00c1 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.683090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:24.684024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.684480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.685294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.686468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:24.686936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:24.689315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:24.704317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 230/466] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:24.705391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.732158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71670551-118e-4de1-a5e3-1ed7b61c4e49 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.766680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24ebe3-7490-4048-a933-d6e177916197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:24.767259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ebe3-7490-4048-a933-d6e177916197 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.767568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ebe3-7490-4048-a933-d6e177916197 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.767848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ebe3-7490-4048-a933-d6e177916197 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.768566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24ebe3-7490-4048-a933-d6e177916197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:24.768867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24ebe3-7490-4048-a933-d6e177916197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:24.770292 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24ebe3-7490-4048-a933-d6e177916197 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:24.781389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 237/467] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:24.782942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ef4f-6277-44ae-95cf-0c1eaa1f9af5 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.783460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ef4f-6277-44ae-95cf-0c1eaa1f9af5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.783932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ef4f-6277-44ae-95cf-0c1eaa1f9af5 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.789371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 238/468] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:24.790339 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ef4f-6277-44ae-95cf-0c1eaa1f9af5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.810077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e064f-1fb8-4015-a0df-f7325cf76c55 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.843179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087a96-acad-47b3-ab7c-741b2cb784a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:24.843952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087a96-acad-47b3-ab7c-741b2cb784a3 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.844220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087a96-acad-47b3-ab7c-741b2cb784a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.844414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087a96-acad-47b3-ab7c-741b2cb784a3 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.845120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c087a96-acad-47b3-ab7c-741b2cb784a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:24.846565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c087a96-acad-47b3-ab7c-741b2cb784a3 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:24.875602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 231/469] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:44:24 2022] POST /identity/v3/users => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:24.875602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087a96-acad-47b3-ab7c-741b2cb784a3 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:24.908226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ef4f-6277-44ae-95cf-0c1eaa1f9af5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.955501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b656db2-3138-426a-a12f-9d5bb448baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:24.956235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656db2-3138-426a-a12f-9d5bb448baa1 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.956478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656db2-3138-426a-a12f-9d5bb448baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.956755 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656db2-3138-426a-a12f-9d5bb448baa1 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:24.958019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b656db2-3138-426a-a12f-9d5bb448baa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:24.960037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b656db2-3138-426a-a12f-9d5bb448baa1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:24.990386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087a96-acad-47b3-ab7c-741b2cb784a3 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:24.991944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 239/470] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:44:24 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:24.993677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5429-65d6-45ba-a852-a8fe655da669 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:24.993970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5429-65d6-45ba-a852-a8fe655da669 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:24.994247 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5429-65d6-45ba-a852-a8fe655da669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.024471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-69ea5429-65d6-45ba-a852-a8fe655da669 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:25.025739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-69ea5429-65d6-45ba-a852-a8fe655da669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:25.029631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30095133-75e5-433b-a39a-303a3bd69dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:25.030420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095133-75e5-433b-a39a-303a3bd69dce None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:25.030777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095133-75e5-433b-a39a-303a3bd69dce None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:25.031126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095133-75e5-433b-a39a-303a3bd69dce None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.031996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30095133-75e5-433b-a39a-303a3bd69dce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:25.033620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30095133-75e5-433b-a39a-303a3bd69dce None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:25.090946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 232/471] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:44:24 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:25.144169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 240/472] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:25.170878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30095133-75e5-433b-a39a-303a3bd69dce None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:25.180858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5128-bcca-4030-a1a4-af353a0001e3 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:25.181156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5128-bcca-4030-a1a4-af353a0001e3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:25.181424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5128-bcca-4030-a1a4-af353a0001e3 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.182826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 241/473] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:44:25.188691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ca7d-e328-4799-9ba6-7b9c05326f0f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:25.189048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ca7d-e328-4799-9ba6-7b9c05326f0f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:25.189330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ca7d-e328-4799-9ba6-7b9c05326f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.222758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8d53ca7d-e328-4799-9ba6-7b9c05326f0f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:25.224720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8d53ca7d-e328-4799-9ba6-7b9c05326f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:25.293431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30095133-75e5-433b-a39a-303a3bd69dce None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:25.311066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 242/474] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:25.334154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:25.334947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:25.335227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:25.335543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.338211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ca7d-e328-4799-9ba6-7b9c05326f0f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:25.346896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:25.348701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:25.368356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:25.369398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:25.370402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:25.370402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:25.370402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:25.370402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:25.372368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 233/475] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:25.377681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:25.480769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ca7d-e328-4799-9ba6-7b9c05326f0f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:25.495182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468bb92-e679-4e46-86e2-c3cc77df99ab None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:25.524708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:25.525788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:25.526212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:25.526753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.528235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:25.529776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:25.531911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:25.532564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:25.532845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:25.533120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.533845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:25.534154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:25.536448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:25.540037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.sql.core [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 18:44:25.540037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 18:44:25.540037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [parameters: {'id': '3e9dc8c9244f4d2d9d2d656edff02c9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 18:44:25.540037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79852) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 18:44:25.559463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 234/476] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:25.564797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result = self._query(query) May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application conn.query(q) May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result.read() May 11 18:44:25.569639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return ref.to_dict() May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 18:44:25.570586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application next(self.gen) May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application yield resource May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application next(self.gen) May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.session.rollback() May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.force_reraise() May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise self.value May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application session.commit() May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 18:44:25.577177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._prepare_impl() May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.session.flush() May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._flush(objects) May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application compat.raise_( May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application flush_context.execute() May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rec.execute(self) May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 18:44:25.578074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 18:44:25.578952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result = self._query(query) May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application conn.query(q) May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result.read() May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 18:44:25.581010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [parameters: {'id': '3e9dc8c9244f4d2d9d2d656edff02c9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:25.583127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 18:44:25.585190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:25.587231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 243/477] 10.222.0.93 () {60 vars in 1131 bytes} [Wed May 11 18:44:25 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:25.596353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:25.694975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278248f-b57b-4da5-8ea1-ffabfa2bc019 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:25.734271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f607-3e37-4ba1-b385-a24e11620a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:25.735335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f607-3e37-4ba1-b385-a24e11620a80 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:25.735920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f607-3e37-4ba1-b385-a24e11620a80 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:25.736779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f607-3e37-4ba1-b385-a24e11620a80 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.737883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091f607-3e37-4ba1-b385-a24e11620a80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:25.739612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091f607-3e37-4ba1-b385-a24e11620a80 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:25.774931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 235/478] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:44:25 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:25.804165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3933a4-52fd-4b56-bcb4-3ecc270f3ab4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:25.842383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e56ea3-68a0-4cfa-ad9f-e3fefa9168a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:25.843782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e56ea3-68a0-4cfa-ad9f-e3fefa9168a7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:25.844302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e56ea3-68a0-4cfa-ad9f-e3fefa9168a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:25.844795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e56ea3-68a0-4cfa-ad9f-e3fefa9168a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:25.856940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e56ea3-68a0-4cfa-ad9f-e3fefa9168a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-c4e56ea3-68a0-4cfa-ad9f-e3fefa9168a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:25.865741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:25.866685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 18:44:25.867502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:25.874846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 244/479] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:44:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:25.880929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f607-3e37-4ba1-b385-a24e11620a80 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:26.022476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f607-3e37-4ba1-b385-a24e11620a80 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:26.057497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac33243-11a1-4b90-902d-9c00ca9e897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:26.058510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac33243-11a1-4b90-902d-9c00ca9e897d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:26.059012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac33243-11a1-4b90-902d-9c00ca9e897d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:26.059534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac33243-11a1-4b90-902d-9c00ca9e897d None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:26.060502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac33243-11a1-4b90-902d-9c00ca9e897d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:26.061009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac33243-11a1-4b90-902d-9c00ca9e897d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:26.062579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac33243-11a1-4b90-902d-9c00ca9e897d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:26.075406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 236/480] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:27.807980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dada6d3-95e4-4acc-90ac-073227503b5d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:27.808511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dada6d3-95e4-4acc-90ac-073227503b5d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:27.808511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dada6d3-95e4-4acc-90ac-073227503b5d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:27.810231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 245/481] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:27.816688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585786a-df90-4871-9011-98f6dcecb877 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:27.817809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585786a-df90-4871-9011-98f6dcecb877 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:27.817809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585786a-df90-4871-9011-98f6dcecb877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:27.841868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9585786a-df90-4871-9011-98f6dcecb877 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:27.843053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9585786a-df90-4871-9011-98f6dcecb877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:27.847276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d73238-8a0a-4c91-8e76-eada2a69506a None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:27.847592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d73238-8a0a-4c91-8e76-eada2a69506a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:27.847863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d73238-8a0a-4c91-8e76-eada2a69506a None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:27.849501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 246/482] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:27.854155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd2f0-1aba-4751-a789-e60782d879e4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:27.854438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd2f0-1aba-4751-a789-e60782d879e4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:27.854712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd2f0-1aba-4751-a789-e60782d879e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:27.880379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-565fd2f0-1aba-4751-a789-e60782d879e4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:27.881563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-565fd2f0-1aba-4751-a789-e60782d879e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:27.952056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 237/483] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:27.976944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585786a-df90-4871-9011-98f6dcecb877 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.000316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 247/484] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:28.002000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102ab5-01be-4782-a19c-070142c80089 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.002485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102ab5-01be-4782-a19c-070142c80089 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.002957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102ab5-01be-4782-a19c-070142c80089 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.004486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 248/485] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:28.012851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec0df4-ffb7-4e06-8df6-468d14fac2e6 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.012851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec0df4-ffb7-4e06-8df6-468d14fac2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.012851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec0df4-ffb7-4e06-8df6-468d14fac2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.027881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-95ec0df4-ffb7-4e06-8df6-468d14fac2e6 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:28.029059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-95ec0df4-ffb7-4e06-8df6-468d14fac2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:28.091557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585786a-df90-4871-9011-98f6dcecb877 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.095073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 249/486] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:28.095956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec0df4-ffb7-4e06-8df6-468d14fac2e6 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.147732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce527682-df45-4ccb-932f-293cf603ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.148612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce527682-df45-4ccb-932f-293cf603ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.148883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce527682-df45-4ccb-932f-293cf603ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.149155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce527682-df45-4ccb-932f-293cf603ecb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.159782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce527682-df45-4ccb-932f-293cf603ecb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-ce527682-df45-4ccb-932f-293cf603ecb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:28.167624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:28.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 238/487] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:28.169712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce527682-df45-4ccb-932f-293cf603ecb3 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.216325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec0df4-ffb7-4e06-8df6-468d14fac2e6 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.260485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c68e-d625-4afc-9b1b-b9554a85f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.261345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c68e-d625-4afc-9b1b-b9554a85f353 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.261625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c68e-d625-4afc-9b1b-b9554a85f353 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.261890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c68e-d625-4afc-9b1b-b9554a85f353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.275537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142c68e-d625-4afc-9b1b-b9554a85f353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:28.285139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce527682-df45-4ccb-932f-293cf603ecb3 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-2142c68e-d625-4afc-9b1b-b9554a85f353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:28.285495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:28.286545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:28.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 250/488] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:28.288128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c68e-d625-4afc-9b1b-b9554a85f353 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.328931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef444e-2654-458d-a9a4-ca1ffcd6a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.329732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef444e-2654-458d-a9a4-ca1ffcd6a373 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.330010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef444e-2654-458d-a9a4-ca1ffcd6a373 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.330280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef444e-2654-458d-a9a4-ca1ffcd6a373 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.346460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef444e-2654-458d-a9a4-ca1ffcd6a373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-c5ef444e-2654-458d-a9a4-ca1ffcd6a373 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:28.357521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:28.358566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:28.359559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:28.367113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 239/489] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:28.367957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef444e-2654-458d-a9a4-ca1ffcd6a373 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.408009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c68e-d625-4afc-9b1b-b9554a85f353 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.456904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.457612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.458097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.458466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.459493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:28.459804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:28.461465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:28.475578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 251/490] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:28.476484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.493800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef444e-2654-458d-a9a4-ca1ffcd6a373 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.540527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.541616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.542523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.542998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.544202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:28.544698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:28.547120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:28.556852 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 240/491] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:28.557905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.585188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03a9f-b953-4f59-9779-7cbeefe5c75e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.630020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.631764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.632230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.632676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.633594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:28.634092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:28.635655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:28.653147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 252/492] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:28.653147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.671769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2d334-d08c-418a-b711-9261e9f68091 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.714356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.715797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.716448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.716915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.731651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:28.733411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:28.756651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:28.757656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:28.758721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:28.758721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:28.758721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:28.758721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:28.761091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 241/493] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:28.762127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.765657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53d95-0dd8-4c73-8b64-00425e5b0640 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.799911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51bd74-8d6d-47a4-ae60-1b47deca2149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.800700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bd74-8d6d-47a4-ae60-1b47deca2149 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.800982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bd74-8d6d-47a4-ae60-1b47deca2149 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.801818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bd74-8d6d-47a4-ae60-1b47deca2149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.812290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51bd74-8d6d-47a4-ae60-1b47deca2149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:28.813754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51bd74-8d6d-47a4-ae60-1b47deca2149 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-0d51bd74-8d6d-47a4-ae60-1b47deca2149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:28.830705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:28.831727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:28.832632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:28.832632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:28.832632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:28.832632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:28.832632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 253/494] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:28.833450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de466-5617-4468-b8d7-15e0ad41344d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.833728 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de466-5617-4468-b8d7-15e0ad41344d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.834000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de466-5617-4468-b8d7-15e0ad41344d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.835414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 254/495] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:28.835943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de466-5617-4468-b8d7-15e0ad41344d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.885934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b411b04-6b91-4cb8-beff-7ef56b7f95c5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.917417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.918194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.918472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.918741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.929309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:28.930751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:28.942175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de466-5617-4468-b8d7-15e0ad41344d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:28.947282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:28.948135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:28.948942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:28.948942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:28.948942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:28.948942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:28.948942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 242/496] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:28.949639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:28.979223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52676-61e9-49dd-9075-a782ae6e7e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:28.979905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52676-61e9-49dd-9075-a782ae6e7e27 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.980186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52676-61e9-49dd-9075-a782ae6e7e27 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.980459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52676-61e9-49dd-9075-a782ae6e7e27 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.981167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52676-61e9-49dd-9075-a782ae6e7e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:28.981472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52676-61e9-49dd-9075-a782ae6e7e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:28.982837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52676-61e9-49dd-9075-a782ae6e7e27 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:28.994174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 255/497] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:28.995469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022c1bc-a17f-4aca-a760-ca06eff6740b None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.995756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022c1bc-a17f-4aca-a760-ca06eff6740b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.996035 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022c1bc-a17f-4aca-a760-ca06eff6740b None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:28.997254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 256/498] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:28.998705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367beca6-672b-4fd0-91d1-c47cd6c3a5be None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:28.999050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367beca6-672b-4fd0-91d1-c47cd6c3a5be None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:28.999435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367beca6-672b-4fd0-91d1-c47cd6c3a5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.015346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-367beca6-672b-4fd0-91d1-c47cd6c3a5be None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:29.016554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-367beca6-672b-4fd0-91d1-c47cd6c3a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:29.043498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6caf25-b904-4650-a2e1-80344d4668b5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.075081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.075756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.076035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.076305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.077018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:29.077317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.078672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.080038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 257/499] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:29.080859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367beca6-672b-4fd0-91d1-c47cd6c3a5be None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.090037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 243/500] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:29.090817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.182081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367beca6-672b-4fd0-91d1-c47cd6c3a5be None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.187995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7f89d-c637-459e-8087-9c39d397aa8e None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.214888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec59b4-0c18-4fe4-92b7-50c123b56a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.215579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec59b4-0c18-4fe4-92b7-50c123b56a73 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.215856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec59b4-0c18-4fe4-92b7-50c123b56a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.216126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec59b4-0c18-4fe4-92b7-50c123b56a73 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.216837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec59b4-0c18-4fe4-92b7-50c123b56a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:29.217137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec59b4-0c18-4fe4-92b7-50c123b56a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.218512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec59b4-0c18-4fe4-92b7-50c123b56a73 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.222910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.224297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.224575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.224843 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.229916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 258/501] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:29.231087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195bf62-cded-424c-ab4f-c6e4dfc07c89 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.231409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195bf62-cded-424c-ab4f-c6e4dfc07c89 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.231675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195bf62-cded-424c-ab4f-c6e4dfc07c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.232065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.233488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.248434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f195bf62-cded-424c-ab4f-c6e4dfc07c89 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:29.249595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f195bf62-cded-424c-ab4f-c6e4dfc07c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:29.249778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:29.250772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:29.251731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 244/502] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:29.252291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.312868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 259/503] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:29.313693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195bf62-cded-424c-ab4f-c6e4dfc07c89 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.351284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c961a-b740-4d38-9bf0-7df652769fb5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.383264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.384076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.384357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.384631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] PATH_INFO: `/v3/users/nova` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.391557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.392999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:29.407584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:29.408531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:29.409400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:29.409894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195bf62-cded-424c-ab4f-c6e4dfc07c89 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.409975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 245/504] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:29.409975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.445036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.445758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.446044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.446319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.455933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.457899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:29.475269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:29.476107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:29.476958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:29.476958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:29.476958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:29.476958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:29.476958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 260/505] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:29.477637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.505001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a83ee4-eb8d-4fb8-bc9a-4de26da87bff None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.538119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.538901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.539180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.539486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.546298 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.547787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:29.562423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:29.563279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:29.564175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 246/506] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:29.564710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.574956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e35f-9a1c-49f0-926a-e1e14ec09519 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.606753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.607562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.607844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.608116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.608946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:29.609253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.610692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.650347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 261/507] 10.222.0.93 () {56 vars in 1137 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:29.650347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.660302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7dd32-7a35-46ab-a26d-bdd9e4313b75 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.693267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8b0e5-20c1-4a6b-8bee-36f4c35ae05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.694048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b0e5-20c1-4a6b-8bee-36f4c35ae05c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.694326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b0e5-20c1-4a6b-8bee-36f4c35ae05c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.694597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b0e5-20c1-4a6b-8bee-36f4c35ae05c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.707669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8b0e5-20c1-4a6b-8bee-36f4c35ae05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-16e8b0e5-20c1-4a6b-8bee-36f4c35ae05c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:29.715289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:29.716177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:29.716957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 247/508] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:29.717618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8b0e5-20c1-4a6b-8bee-36f4c35ae05c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.746115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d5224-76ba-4a12-b4fa-572b98109de4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.777973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.778629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.778906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.779180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.780032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:29.780340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.781778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.798729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 262/509] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:29.799646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.811551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8b0e5-20c1-4a6b-8bee-36f4c35ae05c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.843432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.844087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.844364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.844633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.845353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:29.845657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.847025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.858638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 248/510] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:29.859437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.892733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb16dd4-aeb4-4529-9846-28ab442444ca None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.924819 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.925467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.925747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.926018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:29.926874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:29.927178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:29.928655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:29.945232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 263/511] 10.222.0.93 () {56 vars in 1137 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:29.946018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:29.951884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631ff2-ba38-4979-bae0-09fb7f213950 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:29.984252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3a0d-46a2-45e2-947b-15e7f421461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:29.984826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3a0d-46a2-45e2-947b-15e7f421461a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:29.985107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3a0d-46a2-45e2-947b-15e7f421461a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:29.985382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3a0d-46a2-45e2-947b-15e7f421461a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.038241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2f9aa-a6fa-4dd0-a5d7-607a04f45e9c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.048453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e3a0d-46a2-45e2-947b-15e7f421461a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.049910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e3a0d-46a2-45e2-947b-15e7f421461a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.070581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.071248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.071565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.071838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.072576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:30.072887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.074235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.082272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 264/512] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:30.083280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.143347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 249/513] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:30.144151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3a0d-46a2-45e2-947b-15e7f421461a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.178972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff530b13-51a8-49a5-8934-6978b394ca30 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.214164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41747f-5556-4a83-a729-ac91c92fdbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.214813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41747f-5556-4a83-a729-ac91c92fdbdc None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.215092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41747f-5556-4a83-a729-ac91c92fdbdc None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.215390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41747f-5556-4a83-a729-ac91c92fdbdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.242459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3a0d-46a2-45e2-947b-15e7f421461a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.273700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399717b2-162c-49ce-9cb3-994230a86840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.274353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399717b2-162c-49ce-9cb3-994230a86840 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.274628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399717b2-162c-49ce-9cb3-994230a86840 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.274896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399717b2-162c-49ce-9cb3-994230a86840 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.275617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399717b2-162c-49ce-9cb3-994230a86840 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.277031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399717b2-162c-49ce-9cb3-994230a86840 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.279601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41747f-5556-4a83-a729-ac91c92fdbdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.281087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41747f-5556-4a83-a729-ac91c92fdbdc None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.296274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 250/514] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:44:30 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:30.297099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399717b2-162c-49ce-9cb3-994230a86840 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.399096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 265/515] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:30.400400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41747f-5556-4a83-a729-ac91c92fdbdc None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.412660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399717b2-162c-49ce-9cb3-994230a86840 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.449160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64c3c0-a147-47a8-9074-e6b098f130bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.449689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64c3c0-a147-47a8-9074-e6b098f130bf None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.449992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64c3c0-a147-47a8-9074-e6b098f130bf None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.450272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64c3c0-a147-47a8-9074-e6b098f130bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.508837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41747f-5556-4a83-a729-ac91c92fdbdc None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.518810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64c3c0-a147-47a8-9074-e6b098f130bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.520557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64c3c0-a147-47a8-9074-e6b098f130bf None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.546930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.547760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.548048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.548322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.558867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.560370 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:30.578305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:30.579251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:30.580105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:30.580105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:30.580105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:30.580105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:30.580105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 266/516] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:30.580744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.619917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 251/517] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:30.621101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64c3c0-a147-47a8-9074-e6b098f130bf None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.679926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93d482-6ed2-48a7-b071-287c3e8ab8e4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.713377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.714172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.714453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.714727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.719105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64c3c0-a147-47a8-9074-e6b098f130bf None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.725960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.727466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:30.745224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:30.746134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:30.746982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:30.746982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:30.746982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:30.746982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:30.746982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 267/518] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:30.747243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.759203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.760805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.761251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.761656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.772467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.773942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:30.791287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:30.792202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:30.797809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:30.797809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:30.797809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:30.797809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:30.797809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 252/519] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:30.797809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.847308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6013abe-cd0d-4ef1-addf-11ea233cdc2e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.881447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.882922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.883424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.884296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:30.884607 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.886089 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.897718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 268/520] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:30.898525 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:30.899685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2d2c-0552-4f2c-acdb-829e7480dab4 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:30.934037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:30.934835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:30.935115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:30.935416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:30.945881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:30.947351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:30.965847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:30.967233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:30.968185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:30.968185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:30.968185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:30.968185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:30.968185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 253/521] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:30.968185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.002425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95537afb-96c8-4c09-8f24-5142d906eb89 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.034746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.035350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.036147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.036851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.037130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:31.037431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.038835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.055228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 269/522] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:31.055228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.073569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3473-51f0-4cb3-b34c-2631ef58967b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.108041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.108704 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.108985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.109251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.109965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:31.110265 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.111679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.122989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 254/523] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:31.123871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.155865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef792-5930-4a36-823b-68dc0282ee10 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.191460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.192946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.193226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.193498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.200817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.202276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:31.218385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:31.219426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 18:44:31.220507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:31.224756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 270/524] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:31.225405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.233758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f73f3-237d-4cf3-8026-00269660049d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.265719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.266367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.266646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.266924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.267683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:31.267969 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.269328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.280964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 255/525] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:31.286452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.324303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c56e4c-3b2a-4ab8-9351-836ec53b7444 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.357419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.358197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.358474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.358749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.365438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.366898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.380782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b621f-7551-4d8d-acd0-6467a57cb902 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:31.381868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:31.382686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:31.383921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:31.383921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:31.383921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:31.383921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:31.383921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:31.383921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:31.383921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:31.383921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:31.387651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 271/526] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:31.388645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.415524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.416320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.416601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.416877 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.423615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.425053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:31.440448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:31.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:31.442770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 256/527] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:31.443214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.493311 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d1fa-d3d3-41e7-b794-c804ef0ad1ce None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.526835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.527540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.527919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.528088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.528921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:31.529233 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.530676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.544517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc7cf5-2f12-49e3-b280-d41542262e31 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.547873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 272/528] 10.222.0.93 () {56 vars in 1139 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:31.548935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.578415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.579205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.579518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.579793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.587080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.588646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:31.602759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:31.603772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:31.604602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 257/529] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:31.605380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.655873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454b642-cc32-4e85-bfa2-2b19bc6b7696 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.690535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.691185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.691490 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.691847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.693111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:31.693475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.694985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.703538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b008422-c9a3-4592-84cc-98cba82356dc None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.712745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 273/530] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:31.713591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.741673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.742591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.742869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.743142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.743954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:31.744263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.745690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.768179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 258/531] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:31.768179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:31.811368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d781192-dea6-4a6c-8429-6ae2247d8988 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.844046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074a368-9d29-4024-aee3-66e9bbb6d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.844688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074a368-9d29-4024-aee3-66e9bbb6d89f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.844969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074a368-9d29-4024-aee3-66e9bbb6d89f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.845241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074a368-9d29-4024-aee3-66e9bbb6d89f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.867146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aa1c5-29ae-4388-8964-c3438ffd4b8b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:31.900474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:31.901129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:31.901411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:31.901681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:31.902459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:31.902766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.904209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.912312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074a368-9d29-4024-aee3-66e9bbb6d89f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:31.913756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074a368-9d29-4024-aee3-66e9bbb6d89f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:31.916285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 259/532] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:31.917048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:32.015508 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127cf74-dc9c-4926-8356-a2bd8cc9d843 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:32.026117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 274/533] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:32.026117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074a368-9d29-4024-aee3-66e9bbb6d89f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:32.053990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:32.054716 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.054922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.055197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.056108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=ae471a0d19b04d1daf634d6d2c73645a) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:32.056383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:32.057808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:32.063739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 260/534] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:31 2022] GET /identity/v3/role_assignments?user.id=ae471a0d19b04d1daf634d6d2c73645a&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:32.064494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:32.149249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074a368-9d29-4024-aee3-66e9bbb6d89f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:32.193595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb21133-0c35-4f67-a922-3ab99d2bab15 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:32.203973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:32.204645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.204923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.205192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.206487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:32.206801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:32.210603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:32.215721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 275/535] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:32 2022] GET /identity/v3/role_assignments?user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:32.217673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:32.270069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:32.271125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.271868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.273734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.274861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=9a1d39dd41c348cb9cfdde6fa15da315) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:32.275423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:32.277059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:32.286060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 261/536] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:32 2022] GET /identity/v3/role_assignments?user.id=9a1d39dd41c348cb9cfdde6fa15da315&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:32.362558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456c20e-7699-42f2-a2fa-558951455920 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:32.406385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6edb81-fb9b-4d48-b59f-0bd2052f5be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:32.407589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6edb81-fb9b-4d48-b59f-0bd2052f5be5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.408041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6edb81-fb9b-4d48-b59f-0bd2052f5be5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.408663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6edb81-fb9b-4d48-b59f-0bd2052f5be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.421157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6edb81-fb9b-4d48-b59f-0bd2052f5be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:32.422912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6edb81-fb9b-4d48-b59f-0bd2052f5be5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-9d6edb81-fb9b-4d48-b59f-0bd2052f5be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:32.448324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:32.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:32.450544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:32.450544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:32.450544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:32.450544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:32.452288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 276/537] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:32.458620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:32.571570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeddb8-9f2d-4c02-a082-63bc598e7b46 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:32.573951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64642-c415-4a74-9a08-8c2c391ccdc9 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.574235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64642-c415-4a74-9a08-8c2c391ccdc9 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.574509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64642-c415-4a74-9a08-8c2c391ccdc9 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.576183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 277/538] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:32.582449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834ab6-dace-435d-9331-4d921a98ce76 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.582740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834ab6-dace-435d-9331-4d921a98ce76 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.583017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834ab6-dace-435d-9331-4d921a98ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.603717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-6d834ab6-dace-435d-9331-4d921a98ce76 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:32.604940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6d834ab6-dace-435d-9331-4d921a98ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:32.637378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:32.638396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.638888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.639164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.639923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:32.640227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:32.641606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:32.669691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 262/539] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:32.674902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:32.680683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 278/540] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:32.716313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d834ab6-dace-435d-9331-4d921a98ce76 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:32.784186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff74ca-43c7-4126-bebf-52d9b68214b7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:32.830304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:32.831113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.831420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.831697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.845597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:32.847072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:32.880740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:32.881614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:32.882440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 263/541] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:32.888780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:32.914451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d834ab6-dace-435d-9331-4d921a98ce76 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:32.960464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bfdc5-fa9b-4ace-82a1-d8ce004bf13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:32.961316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bfdc5-fa9b-4ace-82a1-d8ce004bf13c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:32.961593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bfdc5-fa9b-4ace-82a1-d8ce004bf13c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:32.961867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bfdc5-fa9b-4ace-82a1-d8ce004bf13c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:32.982553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bfdc5-fa9b-4ace-82a1-d8ce004bf13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-249bfdc5-fa9b-4ace-82a1-d8ce004bf13c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:33.001551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:33.004002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:33.006138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 279/542] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:33.025446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bfdc5-fa9b-4ace-82a1-d8ce004bf13c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:33.113469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046afce5-5b52-4c20-acd1-a9b98d936989 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:33.138776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bfdc5-fa9b-4ace-82a1-d8ce004bf13c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:33.175412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:33.176739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:33.177011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:33.177437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:33.178191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:33.178492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:33.179920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:33.189162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 280/543] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:33.198285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:33.208631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:33.209308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:33.209583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:33.209852 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:33.210652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:33.210959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:33.212433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:33.241922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 264/544] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:33.248984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:33.314344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c64bbe-e73b-46a7-b4ce-f18bf5448115 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:33.351224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:33.352047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:33.352326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:33.352596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:33.364479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:33.366415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:33.384913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:33.386902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:33.389016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:33.389016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:33.389016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:33.389016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:33.389016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 281/545] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:33.391920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:33.492926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa733f1-5d39-49f9-87de-0da22edf6d7c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:33.529783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355b3e-9009-4c33-b00d-0b78232860b4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:33.558341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:33.559022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:33.559323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:33.559601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:33.560447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=af0204b62913420a90303c42dbded7aa) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:33.560755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:33.562216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:33.576371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 265/546] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:33 2022] GET /identity/v3/role_assignments?user.id=af0204b62913420a90303c42dbded7aa&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:33.602080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:33.603136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:33.603653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:33.604155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:33.605112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:33.605658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:33.607335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:33.626635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 282/547] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:33.632237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:33.773503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d0d8-cd89-4a6c-ad5f-40ca5b7fb78f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:33.815588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:33.816381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:33.816687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:33.816961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:33.824182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:33.825608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:33.859670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:33.860657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:33.861521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 266/548] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:33.867006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:34.017625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36116b4c-6784-4ea5-9f66-201f9af8c47c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:34.066166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:34.067753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:34.068259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:34.068727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:34.069848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:34.070401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:34.072056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:34.104212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 283/549] 10.222.0.93 () {56 vars in 1135 bytes} [Wed May 11 18:44:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:34.109349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:34.234262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696abdcf-2beb-41bd-8b26-4d25710b46a6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:34.268710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ada62-6c4d-409d-804e-3f56245daf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:34.269360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ada62-6c4d-409d-804e-3f56245daf57 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:34.269638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ada62-6c4d-409d-804e-3f56245daf57 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:34.270458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ada62-6c4d-409d-804e-3f56245daf57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:34.339583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ada62-6c4d-409d-804e-3f56245daf57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:34.340965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ada62-6c4d-409d-804e-3f56245daf57 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:34.442281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 267/550] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:34.447415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:34.594968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172d57b-0ca1-4746-89a0-85a141da680b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:34.644157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:34.645527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:34.645811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:34.646082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:34.656963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:34.658422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:34.683533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:34.684432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:34.685257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:34.685257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:34.685257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:34.685257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:34.685257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 284/551] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:34.690682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ada62-6c4d-409d-804e-3f56245daf57 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:34.834272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ada62-6c4d-409d-804e-3f56245daf57 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:34.868142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fb894-10fa-49a2-91c6-a9d0e2fa2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:34.868729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fb894-10fa-49a2-91c6-a9d0e2fa2673 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:34.869006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fb894-10fa-49a2-91c6-a9d0e2fa2673 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:34.869274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fb894-10fa-49a2-91c6-a9d0e2fa2673 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:34.869998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fb894-10fa-49a2-91c6-a9d0e2fa2673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:34.870297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fb894-10fa-49a2-91c6-a9d0e2fa2673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:34.871698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fb894-10fa-49a2-91c6-a9d0e2fa2673 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:34.884248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 268/552] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:34.889279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:34.904925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bace-edab-43b3-a0f0-b75c2a9e78fc None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:34.905263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bace-edab-43b3-a0f0-b75c2a9e78fc None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:34.905423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bace-edab-43b3-a0f0-b75c2a9e78fc None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:34.906793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 269/553] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:44:34.907812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170053a-7043-41b6-bf7c-07c3b1681e99 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:34.908150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170053a-7043-41b6-bf7c-07c3b1681e99 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:34.908430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170053a-7043-41b6-bf7c-07c3b1681e99 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:34.909891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 270/554] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:34.913533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2679-a6c7-4179-8704-31ee2dd252dc None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:34.913794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2679-a6c7-4179-8704-31ee2dd252dc None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:34.914068 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2679-a6c7-4179-8704-31ee2dd252dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:34.934952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-445c2679-a6c7-4179-8704-31ee2dd252dc None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:34.936507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-445c2679-a6c7-4179-8704-31ee2dd252dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:35.015340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 271/555] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:35.015340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed9bd-9f61-4199-a77e-ca87fc5850f8 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.015340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed9bd-9f61-4199-a77e-ca87fc5850f8 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.015340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed9bd-9f61-4199-a77e-ca87fc5850f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.021974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14edd64-59cd-471a-ad83-f6685ecfd454 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.045214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-e00ed9bd-9f61-4199-a77e-ca87fc5850f8 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:35.046758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e00ed9bd-9f61-4199-a77e-ca87fc5850f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:35.067272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.068102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.068380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.068649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.081539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:35.083888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:35.103127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:35.104042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:35.104861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:35.104861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:35.104861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:35.104861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:35.104861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:35.104861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:35.104861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:35.104861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:35.107513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 285/556] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:35.108682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.139407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 272/557] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:35.139407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed9bd-9f61-4199-a77e-ca87fc5850f8 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.247942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796be1-962c-41ce-bfcb-e862537515da None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.252266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed9bd-9f61-4199-a77e-ca87fc5850f8 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.289075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.289831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.290118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.290393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.291182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:35.291529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:35.292945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:35.293365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857ddf-7992-410a-8ccd-5d30fe38469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.294583 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857ddf-7992-410a-8ccd-5d30fe38469a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.295036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857ddf-7992-410a-8ccd-5d30fe38469a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.295673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857ddf-7992-410a-8ccd-5d30fe38469a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.309068 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 273/558] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:35.309068 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.310492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50857ddf-7992-410a-8ccd-5d30fe38469a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-50857ddf-7992-410a-8ccd-5d30fe38469a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:35.318593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:35.319602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:35.320405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 286/559] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:35.321563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a526-f6ce-4698-87c5-3a67a8a124d0 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.321563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a526-f6ce-4698-87c5-3a67a8a124d0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.321563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284a526-f6ce-4698-87c5-3a67a8a124d0 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.323032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 287/560] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:35.323743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284a526-f6ce-4698-87c5-3a67a8a124d0 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.409427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ab05-246d-4805-a5e3-eaddf4ca51f0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.424227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284a526-f6ce-4698-87c5-3a67a8a124d0 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.444592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a024b-924a-44ac-8be4-99e056610c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.445382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a024b-924a-44ac-8be4-99e056610c2b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.445664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a024b-924a-44ac-8be4-99e056610c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.445936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a024b-924a-44ac-8be4-99e056610c2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.456188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a024b-924a-44ac-8be4-99e056610c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:35.458310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db51efa-2f18-4aff-9788-6a74b30ef866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.458963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51efa-2f18-4aff-9788-6a74b30ef866 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.459241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51efa-2f18-4aff-9788-6a74b30ef866 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.459539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51efa-2f18-4aff-9788-6a74b30ef866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.460365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db51efa-2f18-4aff-9788-6a74b30ef866 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=d0583c8ab3414ff6b70acf6267ef0d25) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:35.460672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db51efa-2f18-4aff-9788-6a74b30ef866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:35.462107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db51efa-2f18-4aff-9788-6a74b30ef866 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-4e2a024b-924a-44ac-8be4-99e056610c2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:35.463815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:35.464673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:35.465444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 274/561] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:35.466077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a024b-924a-44ac-8be4-99e056610c2b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.470935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 288/562] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/role_assignments?user.id=d0583c8ab3414ff6b70acf6267ef0d25&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:35.472200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38127-d715-46aa-a8c7-c2b750053168 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.472479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38127-d715-46aa-a8c7-c2b750053168 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.472747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38127-d715-46aa-a8c7-c2b750053168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.490854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b8f38127-d715-46aa-a8c7-c2b750053168 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:35.492513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b8f38127-d715-46aa-a8c7-c2b750053168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:35.569786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 289/563] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:35.569786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38127-d715-46aa-a8c7-c2b750053168 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.617208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a024b-924a-44ac-8be4-99e056610c2b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.664058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.664757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.665039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.665313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.666080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:35.666389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:35.667841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:35.676708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 275/564] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:35.677550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.700596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38127-d715-46aa-a8c7-c2b750053168 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.738175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.738883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.739166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.739475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.740231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:35.740537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:35.742541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:35.753398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 290/565] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:35.754940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.789855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978ebfb-65e6-4f6e-8840-7364364b7a1f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.824439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf205ab-5369-4933-b881-22747a3afc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.825574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf205ab-5369-4933-b881-22747a3afc14 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.826058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf205ab-5369-4933-b881-22747a3afc14 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.826561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf205ab-5369-4933-b881-22747a3afc14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.837621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf205ab-5369-4933-b881-22747a3afc14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-ebf205ab-5369-4933-b881-22747a3afc14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:35.846030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:35.847086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:35.847938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:35.855164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 276/566] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:35.855789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbce19-c39c-44e6-bfac-e885c6758783 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:35.856605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf205ab-5369-4933-b881-22747a3afc14 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.890919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:35.891814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:35.892086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:35.892357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:35.905451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:35.906976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:35.925699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:35.927366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:35.928230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:35.928230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:35.928230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:35.928230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:35.928230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 291/567] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:35.929017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:35.974114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf205ab-5369-4933-b881-22747a3afc14 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.009637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.010812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.011333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.011812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.022783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.024277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.031953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eebe4-8915-400b-a816-a2512c27a3f3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:36.041986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:36.042870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:36.043832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:36.043832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:36.043832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:36.043832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:36.043832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 277/568] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:36.044509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.074668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.075624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.075954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.076229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.076973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:36.077281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.078737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.087382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 292/569] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:36.088251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.147799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a4a5-c388-46ca-b73e-8f8d1951974c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.180788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd1060-8fe1-46af-b337-f25690de697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.181375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd1060-8fe1-46af-b337-f25690de697a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.181652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd1060-8fe1-46af-b337-f25690de697a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.182114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd1060-8fe1-46af-b337-f25690de697a None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.182690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd1060-8fe1-46af-b337-f25690de697a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:36.182954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd1060-8fe1-46af-b337-f25690de697a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.184302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd1060-8fe1-46af-b337-f25690de697a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.184748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ed5d2-c19c-4d9d-9286-da22d8c3c596 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.207192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 278/570] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:36.207192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6c56-5b08-431e-ae8d-d8351e2e56bc None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.207192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6c56-5b08-431e-ae8d-d8351e2e56bc None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.207192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e6c56-5b08-431e-ae8d-d8351e2e56bc None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.209227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 279/571] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:36.212461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e6c56-5b08-431e-ae8d-d8351e2e56bc None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.228788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.229452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.229726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.229994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.230707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:36.231007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.232465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.244738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 293/572] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:36.245550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.323603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e6c56-5b08-431e-ae8d-d8351e2e56bc None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.341309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74006fa-e675-47c0-b06f-7922aa8bf0af None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.357542 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aabaa2-1aec-4068-883a-7b82adf82b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.358321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aabaa2-1aec-4068-883a-7b82adf82b7e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.358594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aabaa2-1aec-4068-883a-7b82adf82b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.358861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aabaa2-1aec-4068-883a-7b82adf82b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.369174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aabaa2-1aec-4068-883a-7b82adf82b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.370625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aabaa2-1aec-4068-883a-7b82adf82b7e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.375073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.375907 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.376187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.376457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.384815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.386256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-a3aabaa2-1aec-4068-883a-7b82adf82b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:36.388910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:36.390312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:36.391319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:36.391319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:36.391319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:36.391319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:36.391319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 280/573] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:36.391319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0862ef-96f7-4b26-bb67-b2fdb0b722d7 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.391654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0862ef-96f7-4b26-bb67-b2fdb0b722d7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.391834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0862ef-96f7-4b26-bb67-b2fdb0b722d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:36.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:36.405519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 18:44:36.406692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:36.411357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7f0862ef-96f7-4b26-bb67-b2fdb0b722d7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:36.411762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7f0862ef-96f7-4b26-bb67-b2fdb0b722d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:36.413684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 294/574] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:36.414602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.476368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 281/575] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:36.477472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0862ef-96f7-4b26-bb67-b2fdb0b722d7 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.527633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46efd-e560-4259-8cb5-00cb8e78ac52 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.560356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.561135 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.561417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.561691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.569716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.571141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.573937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0862ef-96f7-4b26-bb67-b2fdb0b722d7 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:36.585199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:36.586096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:36.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 295/576] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:36.587905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.611520 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.612295 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.612581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.612854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.613634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:36.613939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.615321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.626391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 282/577] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:36.626993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.703756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e738f4-d7cf-46f5-9a1b-933284e4feeb None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.729818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b6365-5c42-436c-aa2e-f19efc053956 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.737005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.737676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.737949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.738219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.739951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:36.740577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.742386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.763093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261826-6a9e-43d2-8e0f-bad2d2a9914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.763920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261826-6a9e-43d2-8e0f-bad2d2a9914c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.764200 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261826-6a9e-43d2-8e0f-bad2d2a9914c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.764469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261826-6a9e-43d2-8e0f-bad2d2a9914c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.767616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 296/578] 10.222.0.93 () {56 vars in 1137 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:36.768393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.776742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41261826-6a9e-43d2-8e0f-bad2d2a9914c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-41261826-6a9e-43d2-8e0f-bad2d2a9914c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:36.784683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:36.785636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 283/579] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:36.787055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261826-6a9e-43d2-8e0f-bad2d2a9914c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.873764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830377c-89f2-41c7-9c4f-5fdb6dce6a6a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.882597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261826-6a9e-43d2-8e0f-bad2d2a9914c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:36.907018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.907718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.908015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.908268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.909168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:36.909482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.911528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.917613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:36.918562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:36.918998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:36.919431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] PATH_INFO: `/v3/users/glance` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:36.927055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:36.928246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 297/580] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:36.928816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:36.929037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:36.944311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:36.945390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 18:44:36.946475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:36.948621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 284/581] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:36.949566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.028139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff9b5-cdee-4f19-890c-4b93d8be5b9d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.047054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dece1-d447-4141-a4bc-157eff0f728f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.060559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.061434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.061783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.062131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.073116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.074653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.079771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.080434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.080718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.080993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.081737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:37.082044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.083967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.096833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 285/582] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:37.096985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:37.098192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:37.099050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:37.099050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:37.099050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:37.099050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:37.099261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.099366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 298/583] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:37.099366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.196261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f983fe-6036-48ea-856d-9a3446674c1c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.202622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83381ee-eca0-44e5-8fb6-af1a910ff750 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.229897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.230560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.230836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.231102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.231965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:37.232325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.233834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.237143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.237933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.238213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.238517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.248954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.250393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.256445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 299/584] 10.222.0.93 () {56 vars in 1137 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:37.256445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:37.268017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:37.268907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:37.269932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:37.269932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:37.269932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:37.269932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:37.269932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 286/585] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:37.270617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.356358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d71273-0210-429a-af3a-44cfb84513f7 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.368554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944af74f-7ae4-4378-a259-6e50d5ed8f4c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.390201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.390994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.391272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.391575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.400732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.401390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.401673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.401771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.401941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.402661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:37.402967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.403212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.404350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.421494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 287/586] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:37.421494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:37.422213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:37.423073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:37.423971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:37.423971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:37.423971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:37.423971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:37.428799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 300/587] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:37.429673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.519231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aea8b-1961-4751-92f9-853f54ff2b83 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.533483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed25c7-d8c1-4f12-b48e-b6b9bd345d36 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.553570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.554361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.554644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.554915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.565136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.566684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.567614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.568300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.568586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.568862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.569593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:37.569901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.571337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.588895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 301/588] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:37.588895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:37.589334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:37.590145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:37.591009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:37.591009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:37.591009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:37.591009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:37.592830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 288/589] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:37.593824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.689199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f055-9fc4-4a95-b9d6-b41ccd8f19c1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.696776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a5e49-6f01-457d-b7d4-3ff18ef66d3f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.721692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.722487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.722789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.723097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.729746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.731183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.731922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.732800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.733310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.733764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.734647 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:37.735120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.736754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:37.745833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:37.746726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 302/590] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:37.752785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.753795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 289/591] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:37.753795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.846346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d643780-ef39-4e06-98f0-f2d38848f6d2 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.847512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c16572-504a-4df4-9e1d-7d36eb6787cd None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.878597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.879431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:37.879550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.879711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.879982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.880070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:37.880344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:37.880618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:37.881332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:37.881634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.882997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.886577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:37.888025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:37.894382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 290/592] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:37.895010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:37.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:37.902383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:37.903266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 303/593] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:37.904191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:37.988100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a123a22-8dea-4b0a-86fa-9575a6c759c0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:37.996325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed825-f98c-4234-9727-54bd732a3cf3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.020310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55394914-263a-47bd-8a5a-afe0af460bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.020962 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394914-263a-47bd-8a5a-afe0af460bb5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.021244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394914-263a-47bd-8a5a-afe0af460bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.021518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394914-263a-47bd-8a5a-afe0af460bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.022299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55394914-263a-47bd-8a5a-afe0af460bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:38.022611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55394914-263a-47bd-8a5a-afe0af460bb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.024136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55394914-263a-47bd-8a5a-afe0af460bb5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.028108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.028894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.029172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.029447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.038604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 291/594] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:38.039913 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1040c-a833-48e8-839a-149797dafd04 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.040246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1040c-a833-48e8-839a-149797dafd04 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.040561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1040c-a833-48e8-839a-149797dafd04 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.042061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 292/595] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:38.042566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1040c-a833-48e8-839a-149797dafd04 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.043433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.044853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:38.064086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:38.066171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 18:44:38.067251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:38.068979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 304/596] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:38.068979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.139289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1040c-a833-48e8-839a-149797dafd04 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.161032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68498a42-a70a-416a-834f-9e30f9368531 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.170700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.171508 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.171784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.172053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.179078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.180525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.193814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711ea86-be3a-4189-bf7d-c1a1a6ff9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.194463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711ea86-be3a-4189-bf7d-c1a1a6ff9e7b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.194743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711ea86-be3a-4189-bf7d-c1a1a6ff9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.195011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711ea86-be3a-4189-bf7d-c1a1a6ff9e7b None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:38.195279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:38.196147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:38.202020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:38.202020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:38.202020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:38.202020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:38.202020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:38.202020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:38.202020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:38.202020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:38.202538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711ea86-be3a-4189-bf7d-c1a1a6ff9e7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:38.202538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711ea86-be3a-4189-bf7d-c1a1a6ff9e7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.202687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 293/597] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:38.202687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.202837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711ea86-be3a-4189-bf7d-c1a1a6ff9e7b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.210113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 305/598] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:38.211395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a781-9193-4792-9442-162549b5e1a0 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.211680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a781-9193-4792-9442-162549b5e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.211952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a781-9193-4792-9442-162549b5e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.228020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-bb47a781-9193-4792-9442-162549b5e1a0 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:38.229195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-bb47a781-9193-4792-9442-162549b5e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:38.291542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 306/599] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:38.292289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47a781-9193-4792-9442-162549b5e1a0 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.302303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924f89-0db0-4007-a402-36f4eddec06c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.335078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a6383-c41c-4881-a5a0-d57cf9201f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.336007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6383-c41c-4881-a5a0-d57cf9201f69 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.336279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6383-c41c-4881-a5a0-d57cf9201f69 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.336541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a6383-c41c-4881-a5a0-d57cf9201f69 None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/ae471a0d19b04d1daf634d6d2c73645a/roles/e46746a1257a4ec8a138a0a31e80a8da` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.350360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a6383-c41c-4881-a5a0-d57cf9201f69 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=ae471a0d19b04d1daf634d6d2c73645a, role_id=e46746a1257a4ec8a138a0a31e80a8da)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.351824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a6383-c41c-4881-a5a0-d57cf9201f69 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.364190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 294/600] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:44:38 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/ae471a0d19b04d1daf634d6d2c73645a/roles/e46746a1257a4ec8a138a0a31e80a8da => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:38.364981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a6383-c41c-4881-a5a0-d57cf9201f69 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.391080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47a781-9193-4792-9442-162549b5e1a0 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.428658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.429355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.429635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.429906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.430772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:38.431084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.432620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.453510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 307/601] 10.222.0.93 () {56 vars in 1139 bytes} [Wed May 11 18:44:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:38.455811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.479773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a6383-c41c-4881-a5a0-d57cf9201f69 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.515883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.516558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.516839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.517114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.517914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:38.518233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.519775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.537731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 295/602] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:38.537731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.571550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac68a9-10d3-4275-a97f-bf76511c4784 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.607275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41f524-bff9-47be-bf7e-28efb0ccf6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.608193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41f524-bff9-47be-bf7e-28efb0ccf6ed None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.608472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41f524-bff9-47be-bf7e-28efb0ccf6ed None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.608753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41f524-bff9-47be-bf7e-28efb0ccf6ed None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/aaff3fdfbc054b8f86a2f9aaa98a70cc/roles/e46746a1257a4ec8a138a0a31e80a8da` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.623288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41f524-bff9-47be-bf7e-28efb0ccf6ed None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=aaff3fdfbc054b8f86a2f9aaa98a70cc, role_id=e46746a1257a4ec8a138a0a31e80a8da)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.624757 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41f524-bff9-47be-bf7e-28efb0ccf6ed None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.637468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 308/603] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:44:38 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/aaff3fdfbc054b8f86a2f9aaa98a70cc/roles/e46746a1257a4ec8a138a0a31e80a8da => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:38.638550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41f524-bff9-47be-bf7e-28efb0ccf6ed None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.654942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e0275-2f41-43dc-a1ba-54a3005096fd None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.700237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2e9a4-c10c-435e-8a6d-dc1f092ea216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.701506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2e9a4-c10c-435e-8a6d-dc1f092ea216 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.702036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2e9a4-c10c-435e-8a6d-dc1f092ea216 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.702506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2e9a4-c10c-435e-8a6d-dc1f092ea216 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.715873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2e9a4-c10c-435e-8a6d-dc1f092ea216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-7de2e9a4-c10c-435e-8a6d-dc1f092ea216 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:38.725137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:38.726135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:38.726943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:38.729740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 296/604] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:38.730858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2e9a4-c10c-435e-8a6d-dc1f092ea216 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.760197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41f524-bff9-47be-bf7e-28efb0ccf6ed None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.797317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.798302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.798413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.798650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.810311 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.811849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:38.831857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:38.832838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:38.833707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:38.833707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:38.833707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:38.833707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:38.833707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 309/605] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:38.834461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.851977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2e9a4-c10c-435e-8a6d-dc1f092ea216 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.887270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39330852-cd52-4457-a22e-d01d0fc71884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.888602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39330852-cd52-4457-a22e-d01d0fc71884 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.889076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39330852-cd52-4457-a22e-d01d0fc71884 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.889564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39330852-cd52-4457-a22e-d01d0fc71884 None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/9a1d39dd41c348cb9cfdde6fa15da315/roles/e46746a1257a4ec8a138a0a31e80a8da` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.906026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39330852-cd52-4457-a22e-d01d0fc71884 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=9a1d39dd41c348cb9cfdde6fa15da315, role_id=e46746a1257a4ec8a138a0a31e80a8da)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.907878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39330852-cd52-4457-a22e-d01d0fc71884 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:38.923150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 297/606] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:44:38 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/9a1d39dd41c348cb9cfdde6fa15da315/roles/e46746a1257a4ec8a138a0a31e80a8da => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:38.924017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39330852-cd52-4457-a22e-d01d0fc71884 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:38.945279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a374b5e-0029-41ac-8d02-62e43af3c20a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:38.984245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:38.985413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:38.985935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:38.986429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:38.987506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:38.988018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:38.990296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.001123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 310/607] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:39.007074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:39.146771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39330852-cd52-4457-a22e-d01d0fc71884 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:39.187809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa641c-9d10-4e00-98e4-36c92c838bb1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:39.190722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:39.191458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:39.192289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:39.192561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:39.193298 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:39.193603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:39.194975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.208339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 298/608] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:39.213484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:39.258042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:39.258849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:39.259128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:39.259426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:39.270989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:39.272832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:39.291997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:39.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:39.293750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:39.293750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:39.293750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:39.293750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:39.293750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 311/609] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:39.298652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:39.406308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d2840-fed2-4bcf-930d-6748e59533fa None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:39.443105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:39.443927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:39.444204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:39.444475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:39.451206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:39.452672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:39.467156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:39.468031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:39.468907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 299/610] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:39.474717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:39.475531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219902e-14e8-4d89-b39e-7dad227e50d7 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:39.554340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:39.555405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:39.555906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:39.556380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:39.557283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:39.557779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:39.559353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.577278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f3a7e-99f6-4505-b2bb-3adedd253412 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:39.585881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 312/611] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:39.592337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:39.613635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:39.614317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:39.614599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:39.614869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:39.615695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:39.616004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:39.617493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.630148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 300/612] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:39.635772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:39.694013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694a18-f7b5-436f-8530-a5c4000880b2 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:39.728054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:39.728859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:39.729141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:39.729414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:39.737043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:39.739036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.739166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feb387-7a72-4ad9-9f28-783506ff79a7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:39.754064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:39.755515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:39.756506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:39.760391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 313/613] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:39.761553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:39.773901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3666a-9410-4a67-873a-c4ffb3775c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:39.774919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3666a-9410-4a67-873a-c4ffb3775c88 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:39.775249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3666a-9410-4a67-873a-c4ffb3775c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:39.775556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3666a-9410-4a67-873a-c4ffb3775c88 None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/af0204b62913420a90303c42dbded7aa/roles/e46746a1257a4ec8a138a0a31e80a8da` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:39.790700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3666a-9410-4a67-873a-c4ffb3775c88 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=af0204b62913420a90303c42dbded7aa, role_id=e46746a1257a4ec8a138a0a31e80a8da)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:39.792171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3666a-9410-4a67-873a-c4ffb3775c88 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.806638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 301/614] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:44:39 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/af0204b62913420a90303c42dbded7aa/roles/e46746a1257a4ec8a138a0a31e80a8da => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:44:39.871777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e65253-bc8c-45ba-9612-08d839f33794 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:39.910430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:39.911194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:39.911555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:39.911894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:39.912799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:39.913113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:39.914635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:39.939480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 314/615] 10.222.0.93 () {56 vars in 1135 bytes} [Wed May 11 18:44:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:39.941453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3666a-9410-4a67-873a-c4ffb3775c88 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:40.054521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3666a-9410-4a67-873a-c4ffb3775c88 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:40.095713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:40.096864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:40.097367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:40.097887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:40.124228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:40.126033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:40.159337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:40.160341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:40.161211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:40.161211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:40.161211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:40.161211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:40.163794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 302/616] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:40.169377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:40.290560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad5ce-a030-43ac-b92a-1bc1c8337f82 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:40.325397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:40.325984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:40.326265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:40.326534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:40.327252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:40.327584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:40.328953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:40.345559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 315/617] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:40.346911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:40.509158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7810-c884-4b43-b3ac-bdc12d5b5e73 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:40.550747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:40.552137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:40.552459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:40.552740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:40.559669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:40.561100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:40.579856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:40.581151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:40.582413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 303/618] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:40.588883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:40.741816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d2898-5a4a-4821-b582-8ae67bfe38ce None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:40.791652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f96f3-922d-4b91-8d30-0af15e2db065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:40.792333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f96f3-922d-4b91-8d30-0af15e2db065 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:40.792612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f96f3-922d-4b91-8d30-0af15e2db065 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:40.792882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f96f3-922d-4b91-8d30-0af15e2db065 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:40.793680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f96f3-922d-4b91-8d30-0af15e2db065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:40.793988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f96f3-922d-4b91-8d30-0af15e2db065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:40.795453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f96f3-922d-4b91-8d30-0af15e2db065 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:40.808362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 316/619] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:40.814214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:40.924828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c7b8-57e3-4d9b-8682-db99da3552a9 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:40.962660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926db877-858e-44c1-bbcc-ba3e6b28413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:40.963579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926db877-858e-44c1-bbcc-ba3e6b28413d None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:40.963854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926db877-858e-44c1-bbcc-ba3e6b28413d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:40.964123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926db877-858e-44c1-bbcc-ba3e6b28413d None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/d0583c8ab3414ff6b70acf6267ef0d25/roles/e46746a1257a4ec8a138a0a31e80a8da` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:40.984249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926db877-858e-44c1-bbcc-ba3e6b28413d None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=d0583c8ab3414ff6b70acf6267ef0d25, role_id=e46746a1257a4ec8a138a0a31e80a8da)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:40.985720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926db877-858e-44c1-bbcc-ba3e6b28413d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:41.003236 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 304/620] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:44:40 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/d0583c8ab3414ff6b70acf6267ef0d25/roles/e46746a1257a4ec8a138a0a31e80a8da => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:41.012892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9f7f-002b-463f-89fe-b2c7e10e5ced None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:41.013217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9f7f-002b-463f-89fe-b2c7e10e5ced None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:41.013436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9f7f-002b-463f-89fe-b2c7e10e5ced None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:41.015132 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 317/621] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:41.020871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3608-d425-47b3-b37e-5abf0b7b5f74 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:41.021173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3608-d425-47b3-b37e-5abf0b7b5f74 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:41.021432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3608-d425-47b3-b37e-5abf0b7b5f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:41.039792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4b4a3608-d425-47b3-b37e-5abf0b7b5f74 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:41.040996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4b4a3608-d425-47b3-b37e-5abf0b7b5f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:41.123136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 305/622] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:41.159271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad9f7f-002b-463f-89fe-b2c7e10e5ced None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:41.304688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad9f7f-002b-463f-89fe-b2c7e10e5ced None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:41.343923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7432ed-9c3d-4193-aed9-a0b1d20eaf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:41.344733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7432ed-9c3d-4193-aed9-a0b1d20eaf25 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:41.345014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7432ed-9c3d-4193-aed9-a0b1d20eaf25 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:41.345284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7432ed-9c3d-4193-aed9-a0b1d20eaf25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:41.357623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7432ed-9c3d-4193-aed9-a0b1d20eaf25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-3c7432ed-9c3d-4193-aed9-a0b1d20eaf25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:41.366131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:41.367125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:41.368024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 318/623] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:41.374916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3608-d425-47b3-b37e-5abf0b7b5f74 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:41.479216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3608-d425-47b3-b37e-5abf0b7b5f74 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:41.487492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e11031-36d4-4c1a-b8a3-34ac5af99fbc None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:41.487781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e11031-36d4-4c1a-b8a3-34ac5af99fbc None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:41.488065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e11031-36d4-4c1a-b8a3-34ac5af99fbc None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:41.489751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 319/624] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:41.494850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a41a-d60e-480f-96c2-1940d1a70407 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:41.495151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a41a-d60e-480f-96c2-1940d1a70407 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:41.495431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a41a-d60e-480f-96c2-1940d1a70407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:41.512234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f432a41a-d60e-480f-96c2-1940d1a70407 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:41.513436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f432a41a-d60e-480f-96c2-1940d1a70407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:41.525983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:41.526660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:41.526941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:41.527222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:41.528001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:41.528305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:41.529681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:41.544384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 306/625] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:41.550159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:41.633270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 320/626] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:41.693495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432a41a-d60e-480f-96c2-1940d1a70407 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:41.701503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b5be-ab72-4e2b-9a68-57eb8db0f33c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:41.739973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:41.740695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:41.740977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:41.741252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:41.753059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:41.755925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:41.775563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:41.776523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:41.777387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:41.777387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:41.777387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:41.777387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:41.777387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 307/627] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:41.783581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:41.898896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432a41a-d60e-480f-96c2-1940d1a70407 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:41.912380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39005-0c58-4372-84f5-ca7aad626a3d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:41.959641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:41.960336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:41.960741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:41.961022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:41.961778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:41.962084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:41.963537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:41.986105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 308/628] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:41.992801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.061854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe90c5-e14b-45fe-890d-7a802b752107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.062707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe90c5-e14b-45fe-890d-7a802b752107 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.063022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe90c5-e14b-45fe-890d-7a802b752107 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.063325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe90c5-e14b-45fe-890d-7a802b752107 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.077798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe90c5-e14b-45fe-890d-7a802b752107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-afbe90c5-e14b-45fe-890d-7a802b752107 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:42.088374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:42.089304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:42.090112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:42.090752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 321/629] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:42.092582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3193e-429f-421a-8744-04bff54625c3 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.092869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3193e-429f-421a-8744-04bff54625c3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.093142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3193e-429f-421a-8744-04bff54625c3 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.099377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 322/630] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:42.100510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3193e-429f-421a-8744-04bff54625c3 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.119133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97354388-7f6d-4043-900b-6e5e9ee0f448 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.154438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0970c9-a4cf-4219-ba79-ceb8fe6a8830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.155239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0970c9-a4cf-4219-ba79-ceb8fe6a8830 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.155600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0970c9-a4cf-4219-ba79-ceb8fe6a8830 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.155884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0970c9-a4cf-4219-ba79-ceb8fe6a8830 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.163489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0970c9-a4cf-4219-ba79-ceb8fe6a8830 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:42.165007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0970c9-a4cf-4219-ba79-ceb8fe6a8830 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-3b0970c9-a4cf-4219-ba79-ceb8fe6a8830 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:42.180687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:42.182982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 18:44:42.185208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:42.186454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 309/631] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:42.191463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3ddb-8496-4049-9d1c-b1d4d4b38563 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.191463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3ddb-8496-4049-9d1c-b1d4d4b38563 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.191463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e3ddb-8496-4049-9d1c-b1d4d4b38563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.208874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-394e3ddb-8496-4049-9d1c-b1d4d4b38563 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:42.210064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-394e3ddb-8496-4049-9d1c-b1d4d4b38563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:42.211591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3193e-429f-421a-8744-04bff54625c3 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.248052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.249058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.249572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.250122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.251278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:42.251899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:42.253494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:42.268518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 323/632] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:42.270311 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.295425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 310/633] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:42.296358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e3ddb-8496-4049-9d1c-b1d4d4b38563 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.376391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433824-7a4e-42a2-9b82-088852f8c9d4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.412086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.413130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.413812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.414297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.415363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:42.415913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:42.417577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:42.420127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e3ddb-8496-4049-9d1c-b1d4d4b38563 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.437971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 324/634] 10.222.0.93 () {56 vars in 1137 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:42.439154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.462067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.462599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.462880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.463148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.478173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:42.479777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:42.502731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:42.503668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:42.505175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:42.505175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:42.505175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:42.505175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:42.509086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 311/635] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:42.509958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.556008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946aeb6-f631-44b6-af3f-40ff61637c73 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.589335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edc1f8-6ad1-4b3e-b1d2-d92b5b370f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.590131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edc1f8-6ad1-4b3e-b1d2-d92b5b370f14 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.590403 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edc1f8-6ad1-4b3e-b1d2-d92b5b370f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.590667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edc1f8-6ad1-4b3e-b1d2-d92b5b370f14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.600559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edc1f8-6ad1-4b3e-b1d2-d92b5b370f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-46edc1f8-6ad1-4b3e-b1d2-d92b5b370f14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:42.608197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:42.609303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:42.610148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 325/636] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:42.610831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edc1f8-6ad1-4b3e-b1d2-d92b5b370f14 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.624758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd3cfa-43f2-4c44-97f0-fce3930ff062 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.658502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c9b4d-29f9-45af-9572-61f9c030cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.659155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9b4d-29f9-45af-9572-61f9c030cd79 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.659480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9b4d-29f9-45af-9572-61f9c030cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.659761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9b4d-29f9-45af-9572-61f9c030cd79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.712561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edc1f8-6ad1-4b3e-b1d2-d92b5b370f14 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.724468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c9b4d-29f9-45af-9572-61f9c030cd79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:42.725983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c9b4d-29f9-45af-9572-61f9c030cd79 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:42.748170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b33c-d2e8-47bd-af8f-02551bfa87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.748831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b33c-d2e8-47bd-af8f-02551bfa87c7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.749113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b33c-d2e8-47bd-af8f-02551bfa87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.749386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b33c-d2e8-47bd-af8f-02551bfa87c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.750106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114b33c-d2e8-47bd-af8f-02551bfa87c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:42.750414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114b33c-d2e8-47bd-af8f-02551bfa87c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:42.751803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114b33c-d2e8-47bd-af8f-02551bfa87c7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:42.768185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 326/637] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:42.768185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf04bda-cf2c-4720-9c18-ef56848697ff None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.768185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf04bda-cf2c-4720-9c18-ef56848697ff None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.768185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf04bda-cf2c-4720-9c18-ef56848697ff None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.768185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 327/638] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:42.768185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf04bda-cf2c-4720-9c18-ef56848697ff None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.837535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 312/639] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:42.837535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c9b4d-29f9-45af-9572-61f9c030cd79 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:42.874593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf04bda-cf2c-4720-9c18-ef56848697ff None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.908419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b3dca-6e64-4194-ac57-cad99fc37511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.909084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3dca-6e64-4194-ac57-cad99fc37511 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.909363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3dca-6e64-4194-ac57-cad99fc37511 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.909640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3dca-6e64-4194-ac57-cad99fc37511 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.910381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b3dca-6e64-4194-ac57-cad99fc37511 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:42.910686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b3dca-6e64-4194-ac57-cad99fc37511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:42.912071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b3dca-6e64-4194-ac57-cad99fc37511 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:42.924189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 328/640] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:42.924189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615634-8e1b-42c2-b2c3-39ef844a8228 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.924189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615634-8e1b-42c2-b2c3-39ef844a8228 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.924189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615634-8e1b-42c2-b2c3-39ef844a8228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.935578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c9b4d-29f9-45af-9572-61f9c030cd79 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:42.942158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-80615634-8e1b-42c2-b2c3-39ef844a8228 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:42.944075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-80615634-8e1b-42c2-b2c3-39ef844a8228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:42.969315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:42.970112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:42.970393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:42.970664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:42.977884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:42.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:42.994919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:42.995919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:42.996808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 313/641] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:42.997398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.018504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 329/642] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:43.022017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80615634-8e1b-42c2-b2c3-39ef844a8228 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.118009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97d641-57ea-4ad3-bfd0-c91b74cbc494 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.130325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80615634-8e1b-42c2-b2c3-39ef844a8228 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.155418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.156209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.156485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.156760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.163794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.164581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.164862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.165134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.167538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.169004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.175086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.177099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:43.186816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:43.188001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:43.188998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:43.188998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:43.188998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:43.188998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:43.192898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 314/643] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:43.192898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:43.194694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:43.195763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:43.196952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:43.196952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:43.196952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:43.196952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:43.198171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 330/644] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:43.199884 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.298699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121cd4-a221-49f8-b785-f2e94bb91fb4 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.301124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e9f7-5b6c-4706-bc05-89582d5397a8 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.331545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.332488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.332771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.333042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.333875 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:43.334183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.335019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ccbb4-abf8-4ccb-bf8b-b627f4417ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.335678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.335847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ccbb4-abf8-4ccb-bf8b-b627f4417ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.336125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ccbb4-abf8-4ccb-bf8b-b627f4417ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.336397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ccbb4-abf8-4ccb-bf8b-b627f4417ec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.346995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ccbb4-abf8-4ccb-bf8b-b627f4417ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-8f3ccbb4-abf8-4ccb-bf8b-b627f4417ec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:43.355499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:43.356550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:43.357384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:43.361066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 331/645] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:43.361066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ccbb4-abf8-4ccb-bf8b-b627f4417ec9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.377842 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 315/646] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:43.380666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.461074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ccbb4-abf8-4ccb-bf8b-b627f4417ec9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.480663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5111dc8-1e98-494c-b1b5-e86ba946a10c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.494438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.495539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.496056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.496530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.497455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:43.497959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.499555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.511770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 332/647] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:43.513031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.515273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.516348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.516557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.516839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.517568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:43.517876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.519266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.531031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 316/648] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:43.531870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.611941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a36b-5536-4339-94c8-0c95d0679a3e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.624944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cd14d-f55b-410d-adf7-bd33dc91d820 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.644109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.644772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.645042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.645309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.646038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:43.646340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.647734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.655213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 333/649] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:43.655997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.656867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d49abe-408e-43c3-9a4a-5522daed3eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.657510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d49abe-408e-43c3-9a4a-5522daed3eec None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.657786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d49abe-408e-43c3-9a4a-5522daed3eec None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.658049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d49abe-408e-43c3-9a4a-5522daed3eec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.723318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d49abe-408e-43c3-9a4a-5522daed3eec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.724806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d49abe-408e-43c3-9a4a-5522daed3eec None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.747360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa759a80-3bc8-4302-83fb-66155aa77134 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.778807 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.779607 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.779877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.780139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.787021 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.788463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:43.802105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:43.803070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 334/650] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:43.804013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.818588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 317/651] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:43.819922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0ff5-576b-4087-be6f-b955a5984545 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.820207 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0ff5-576b-4087-be6f-b955a5984545 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.820481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0ff5-576b-4087-be6f-b955a5984545 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.821734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 318/652] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:43.822430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0ff5-576b-4087-be6f-b955a5984545 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.901806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd1ca0-45ca-4953-8f8b-500fe1923b5a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.917805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0ff5-576b-4087-be6f-b955a5984545 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:43.932847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.933621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.933896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.934166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.941181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.943128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.950258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:43.951030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:43.951326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:43.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:43.957692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:43.958567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 335/653] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:43.959777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:43.966050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:43.967529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:43.984940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:43.985981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:43.986933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:43.986933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:43.986933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:43.986933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:43.986933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 319/654] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:43.986933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.053858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17528845-4270-48a9-b2d5-7c8a71f71c00 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.079620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54061ecd-1395-43dc-9dfb-2341c98f37aa None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.085075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f7e74-1f27-4c29-933e-e1d04b5d7656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.085714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f7e74-1f27-4c29-933e-e1d04b5d7656 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.085991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f7e74-1f27-4c29-933e-e1d04b5d7656 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.086256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f7e74-1f27-4c29-933e-e1d04b5d7656 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.087022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f7e74-1f27-4c29-933e-e1d04b5d7656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:44.087342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f7e74-1f27-4c29-933e-e1d04b5d7656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.088755 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f7e74-1f27-4c29-933e-e1d04b5d7656 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.100679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 336/655] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:44.101635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57987e0-9a23-43df-a221-f91e6518dea9 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.101914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57987e0-9a23-43df-a221-f91e6518dea9 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.102180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57987e0-9a23-43df-a221-f91e6518dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.111832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.112598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.112878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.113152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.117465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a57987e0-9a23-43df-a221-f91e6518dea9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:44.118637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a57987e0-9a23-43df-a221-f91e6518dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:44.123544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.124995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:44.142080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:44.143091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:44.144040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:44.144040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:44.144040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:44.144040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:44.144040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 320/656] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:44.144425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.181596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 337/657] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:44.182314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57987e0-9a23-43df-a221-f91e6518dea9 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.253607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ede4e-174c-4a1a-b0ee-00833b160a28 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.277236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57987e0-9a23-43df-a221-f91e6518dea9 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.289370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.290036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.290309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.290578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.291440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:44.291744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.293168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.312770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.312978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 321/658] 10.222.0.93 () {56 vars in 1137 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:44.313432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.313693 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.313774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.314056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.314775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:44.315355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.316760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.327928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 338/659] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:44.328723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.407532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63c3ba-730f-4104-bac7-36122f2a8a92 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.421467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2dfd-b57e-4962-8ada-24eab5a360cd None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.439765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.440607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.440886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.441160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.442009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=ae471a0d19b04d1daf634d6d2c73645a) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:44.442315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.443770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.449329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 322/660] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/role_assignments?user.id=ae471a0d19b04d1daf634d6d2c73645a&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:44.450085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.461044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.461736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.462322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.462322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.463020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:44.463355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.464787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.478447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 339/661] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:44.479706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.562203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a606b5-bcfc-4bf9-8cb2-7ad29815eeb0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.592919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4765c-239c-4d83-994d-b16e1f5969b8 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.598511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baac74-d2d5-412e-a658-8b7e236805b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.599347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baac74-d2d5-412e-a658-8b7e236805b6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.599635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baac74-d2d5-412e-a658-8b7e236805b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.599907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baac74-d2d5-412e-a658-8b7e236805b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.612709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baac74-d2d5-412e-a658-8b7e236805b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-34baac74-d2d5-412e-a658-8b7e236805b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:44.621481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:44.622537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 323/662] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:44.628579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baac74-d2d5-412e-a658-8b7e236805b6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.635281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de628a-9c14-4b11-afdd-5bc3d31bf484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.636417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de628a-9c14-4b11-afdd-5bc3d31bf484 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.636702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de628a-9c14-4b11-afdd-5bc3d31bf484 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.636975 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de628a-9c14-4b11-afdd-5bc3d31bf484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.707944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de628a-9c14-4b11-afdd-5bc3d31bf484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.709321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de628a-9c14-4b11-afdd-5bc3d31bf484 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.735386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baac74-d2d5-412e-a658-8b7e236805b6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.767390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.768189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.768466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.768736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.776224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.777655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:44.792264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:44.793210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:44.794163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 324/663] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:44.794775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.815929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 340/664] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:44.815929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de628a-9c14-4b11-afdd-5bc3d31bf484 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.895802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b42f-1235-4789-8e2f-7edf1e8a720f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.910654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de628a-9c14-4b11-afdd-5bc3d31bf484 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:44.928194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.928980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.929258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.929527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.936004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.937437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.943945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:44.944680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:44.945030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:44.945371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:44.946186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:44.946560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:44.948010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:44.951606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:44.952632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:44.953723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:44.953723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:44.953723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:44.953723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:44.953723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:44.953723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:44.953723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:44.953723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:44.958061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 325/665] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:44.962702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 341/666] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:44.962848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:44.962942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.060394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba5ea8-ac9e-4aad-ac68-b59307553b4b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.065540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef74759-193c-4a9f-8ac4-833ce087cfda None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.096346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.097094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.097459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.097827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.098724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:45.099089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.100307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.100692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.101239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.101594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.101938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.112561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.114596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.123873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 326/667] 10.222.0.93 () {56 vars in 1139 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:45.123873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:45.132162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:45.133185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:45.134254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:45.134254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:45.134254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:45.134254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:45.139672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 342/668] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:45.139672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.222003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a794-255a-4550-adaa-929d914715d8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.236113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66679e4-e9af-4423-b6b3-981b761fdecb None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.256463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.257125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.257409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.257685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.258477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:45.258785 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.260240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.270206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.271014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.271316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.271809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.271915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 327/669] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:45.272462 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.287973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.289443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:45.306849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:45.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:45.313741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:45.313741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:45.313741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:45.313741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:45.313741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 343/670] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:45.313741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.371219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8e0bc-fb5e-4fba-b592-bb2753445b72 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.402814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39b1f8-4068-4e6f-9848-6c8948c471e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.403484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39b1f8-4068-4e6f-9848-6c8948c471e7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.403763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39b1f8-4068-4e6f-9848-6c8948c471e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.404034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39b1f8-4068-4e6f-9848-6c8948c471e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.412633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75ea6-a9fe-497b-8925-b505d9b647c0 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.446373 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.447111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.447386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.447625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.448337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:45.448641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.450013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.461433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 344/671] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:45.462213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.475663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39b1f8-4068-4e6f-9848-6c8948c471e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.477135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39b1f8-4068-4e6f-9848-6c8948c471e7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.558960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250488-4001-401e-8cda-c667fac69efb None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.573796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 328/672] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:45.578706 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39b1f8-4068-4e6f-9848-6c8948c471e7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.592787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.593438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.593721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.593995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.594813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:45.595121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.596590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.611344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 345/673] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/role_assignments?user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:45.611344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.705379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39b1f8-4068-4e6f-9848-6c8948c471e7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.726229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570d48-212d-4708-89b6-86bc1cffcfd9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.743412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.744257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.744629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.744997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.745832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:45.746234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.747924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.765132 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 329/674] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:45.766249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.769277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.771202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.771586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.771934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.781240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.783516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:45.804476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:45.805586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:45.806662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:45.806662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:45.806662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:45.806662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:45.806662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:45.806662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:45.806662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:45.806662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:45.809341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 346/675] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:45.809341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.888635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec253b4-81eb-421d-8a30-fb6c7d17e24f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.926852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a1b75-c825-4aa2-aaf2-509520b4c298 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:45.932678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.933477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.933756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.934025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.948579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.950035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.967382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:45.968496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:45.968978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:45.969450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:45.969572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:45.970407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:45.971276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:45.971276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:45.971276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:45.971276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:45.971276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 330/676] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:45.971991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:45.980030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:45.981769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:45.997613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:45.998548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:45.999500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:46.002091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 347/677] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:46.003066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.079339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943275f5-e520-41f7-98da-a2d4cf769fbd None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.104662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868fdc-dfc8-4cc3-b0ce-69fc5b83c3cd None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.113778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.114448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.114725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.114994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.115811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:46.116344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.117525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.135279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 331/678] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:46.136286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.142248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.143172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.143685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.144183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.145172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:46.145680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.147277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.161447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 348/679] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:46.166769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.247050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e99cb-a292-4c8b-8e8d-f83bc2e551a8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.267814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4280-fad1-405e-9ea2-36523ad14c3d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.284367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.285941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.286483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.286974 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.288103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:46.288616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.290260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.303023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.303969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.304269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.304540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.305374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=9a1d39dd41c348cb9cfdde6fa15da315) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:46.305662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.307108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.312664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 332/680] 10.222.0.93 () {56 vars in 1135 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:46.313795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.319709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 349/681] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/role_assignments?user.id=9a1d39dd41c348cb9cfdde6fa15da315&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:46.320678 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.484454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead34c-7b2e-4934-ac12-c44861277566 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.509403 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfe4e2-e87f-4e41-8a6a-6fe9f2a52b56 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.549190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.551187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.551714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.552195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.561491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.564656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1908c-2cc1-4781-92e3-b635f074c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.565115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1908c-2cc1-4781-92e3-b635f074c86b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.565336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1908c-2cc1-4781-92e3-b635f074c86b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.565548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1908c-2cc1-4781-92e3-b635f074c86b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.566112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:46.583083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:46.585146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:46.586034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:46.586034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:46.586034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:46.586034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:46.586034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:46.586034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:46.586034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:46.586034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:46.588730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 333/682] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:46.594606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.649823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1908c-2cc1-4781-92e3-b635f074c86b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.651549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1908c-2cc1-4781-92e3-b635f074c86b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.715469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6431-180b-43cf-8e27-8d0b4ca83924 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.754834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999687d4-94e9-421e-9ad3-978725cc36e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.756385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999687d4-94e9-421e-9ad3-978725cc36e0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.756873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999687d4-94e9-421e-9ad3-978725cc36e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.757365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999687d4-94e9-421e-9ad3-978725cc36e0 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.758354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999687d4-94e9-421e-9ad3-978725cc36e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:46.758932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999687d4-94e9-421e-9ad3-978725cc36e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.760708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999687d4-94e9-421e-9ad3-978725cc36e0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.767950 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 350/683] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:46.776452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1908c-2cc1-4781-92e3-b635f074c86b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.778778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 334/684] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:46.783343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f8b2f-f9a9-4def-81ed-4b5730c5dfa2 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.783343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f8b2f-f9a9-4def-81ed-4b5730c5dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.783343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f8b2f-f9a9-4def-81ed-4b5730c5dfa2 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.783343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 335/685] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:46.787080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f8b2f-f9a9-4def-81ed-4b5730c5dfa2 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.885773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1908c-2cc1-4781-92e3-b635f074c86b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.907754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f8b2f-f9a9-4def-81ed-4b5730c5dfa2 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:46.919323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5727e1-e752-4197-9cdf-85f08bbe7ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.920211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5727e1-e752-4197-9cdf-85f08bbe7ff0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.920491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5727e1-e752-4197-9cdf-85f08bbe7ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.920764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5727e1-e752-4197-9cdf-85f08bbe7ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.931427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5727e1-e752-4197-9cdf-85f08bbe7ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.932905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5727e1-e752-4197-9cdf-85f08bbe7ff0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.952977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:46.953647 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.953926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.954198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.955051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=af0204b62913420a90303c42dbded7aa) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:46.955408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-ef5727e1-e752-4197-9cdf-85f08bbe7ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:46.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:46.957210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:46.958106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:46.958106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:46.958106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:46.958106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:46.958319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:46.964814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 351/687] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:46.966588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c3b57-fde8-41e8-8091-6cf8d875b1a7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:46.967061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c3b57-fde8-41e8-8091-6cf8d875b1a7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:46.967545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c3b57-fde8-41e8-8091-6cf8d875b1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:46.971436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 336/687] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/role_assignments?user.id=af0204b62913420a90303c42dbded7aa&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:46.972983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:46.995887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9b8c3b57-fde8-41e8-8091-6cf8d875b1a7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:46.997440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9b8c3b57-fde8-41e8-8091-6cf8d875b1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:47.087549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c1db-5dbe-4a7c-acc0-f8b2a72c340f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:47.119819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:47.120493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:47.120769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:47.121041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:47.121771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:47.122074 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:47.123483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:47.136816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 337/688] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:47.137315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 352/689] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:47.148452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:47.176343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c3b57-fde8-41e8-8091-6cf8d875b1a7 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:47.283106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ccf73-4893-4b04-9164-64a48773c68a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:47.301147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c3b57-fde8-41e8-8091-6cf8d875b1a7 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:47.322888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:47.323865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:47.324368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:47.324831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:47.332630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:47.334596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:47.337725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:47.338770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:47.339189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:47.339638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:47.340424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:47.342017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:47.350954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:47.351869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:47.352724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 338/690] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:47.358052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:47.359475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:47.360381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:47.361200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:47.364134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 353/691] 10.222.0.93 () {56 vars in 1129 bytes} [Wed May 11 18:44:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:47.369837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:47.467746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdb643-6db1-4ae5-9d3c-81381c98e665 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:47.474282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e82bec-f25d-4cd2-9abe-9aa31c7d3047 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:47.508615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:47.509584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:47.510493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:47.510938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:47.511817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:47.512255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:47.513758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:47.518557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 354/692] 10.222.0.93 () {56 vars in 1124 bytes} [Wed May 11 18:44:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:47.520973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:47.521783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:47.522258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:47.522650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:47.523607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:47.524050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:47.525221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:47.529579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:47.549373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 339/693] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:47.555138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:47.683752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17482bf9-0f7e-46aa-9cad-750f5709297a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:47.724153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae09550-7195-4e3d-a2eb-d8f60d4c0fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:47.725181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09550-7195-4e3d-a2eb-d8f60d4c0fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:47.725655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09550-7195-4e3d-a2eb-d8f60d4c0fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:47.726144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09550-7195-4e3d-a2eb-d8f60d4c0fc8 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:47.729766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09550-7195-4e3d-a2eb-d8f60d4c0fc8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:47.730284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09550-7195-4e3d-a2eb-d8f60d4c0fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:47.731891 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09550-7195-4e3d-a2eb-d8f60d4c0fc8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:47.741495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 355/694] 10.222.0.93 () {56 vars in 1124 bytes} [Wed May 11 18:44:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:47.757639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6f0be-8237-4094-aece-c58a125a1d72 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:47.812208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b268ec9-ccc0-4201-b1e8-9522f2ddb3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:47.813283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268ec9-ccc0-4201-b1e8-9522f2ddb3fa None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:47.813766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268ec9-ccc0-4201-b1e8-9522f2ddb3fa None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:47.814258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268ec9-ccc0-4201-b1e8-9522f2ddb3fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:47.815616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b268ec9-ccc0-4201-b1e8-9522f2ddb3fa None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=d0583c8ab3414ff6b70acf6267ef0d25) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:47.816132 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b268ec9-ccc0-4201-b1e8-9522f2ddb3fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:47.818359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b268ec9-ccc0-4201-b1e8-9522f2ddb3fa None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:47.825442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 340/695] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:47 2022] GET /identity/v3/role_assignments?user.id=d0583c8ab3414ff6b70acf6267ef0d25&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:48.272254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d25d-e7d5-41f7-a836-8ee8c807e3fd None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:48.272873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d25d-e7d5-41f7-a836-8ee8c807e3fd None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:48.273344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d25d-e7d5-41f7-a836-8ee8c807e3fd None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:48.275151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 356/696] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:48.280228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ad2e-3f3d-40dc-8819-46f3bd159bb2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:48.280770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ad2e-3f3d-40dc-8819-46f3bd159bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:48.281248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ad2e-3f3d-40dc-8819-46f3bd159bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:48.300588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-40c5ad2e-3f3d-40dc-8819-46f3bd159bb2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:48.302627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-40c5ad2e-3f3d-40dc-8819-46f3bd159bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:48.380274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 341/697] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:48.403104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3d25d-e7d5-41f7-a836-8ee8c807e3fd None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:48.513146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3d25d-e7d5-41f7-a836-8ee8c807e3fd None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:48.556966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f15141-6158-42a7-9b67-019a96aeb622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:48.557774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f15141-6158-42a7-9b67-019a96aeb622 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:48.558058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f15141-6158-42a7-9b67-019a96aeb622 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:48.558340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f15141-6158-42a7-9b67-019a96aeb622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:48.573044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f15141-6158-42a7-9b67-019a96aeb622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-35f15141-6158-42a7-9b67-019a96aeb622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:48.580706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:48.581595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:48.582466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 357/698] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:48.588030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ad2e-3f3d-40dc-8819-46f3bd159bb2 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:48.731360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ad2e-3f3d-40dc-8819-46f3bd159bb2 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:48.777281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eeb82-006d-469f-b5e2-b8f7eaead984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:48.777886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eeb82-006d-469f-b5e2-b8f7eaead984 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:48.778130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eeb82-006d-469f-b5e2-b8f7eaead984 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:48.778404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eeb82-006d-469f-b5e2-b8f7eaead984 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:48.779163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eeb82-006d-469f-b5e2-b8f7eaead984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:48.779500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eeb82-006d-469f-b5e2-b8f7eaead984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:48.780865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eeb82-006d-469f-b5e2-b8f7eaead984 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:48.794814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 342/699] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:48.804349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f15141-6158-42a7-9b67-019a96aeb622 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:48.966385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f15141-6158-42a7-9b67-019a96aeb622 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:49.020561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:49.021376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:49.021659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:49.021939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:49.035646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:49.037039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:49.053583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecdc5-a824-4dae-b998-f5058f78fe3d None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:49.053871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecdc5-a824-4dae-b998-f5058f78fe3d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:49.054147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecdc5-a824-4dae-b998-f5058f78fe3d None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:49.056936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 343/700] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:49.057902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:49.058824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:49.059721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:49.059721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:49.059721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:49.059721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:49.059721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 358/701] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:49.060914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8efb7-beab-49e3-b314-3f831ba21dfe None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:49.061196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8efb7-beab-49e3-b314-3f831ba21dfe None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:49.061471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8efb7-beab-49e3-b314-3f831ba21dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:49.065589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:49.089315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-09b8efb7-beab-49e3-b314-3f831ba21dfe None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:49.090498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-09b8efb7-beab-49e3-b314-3f831ba21dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:49.199813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 344/702] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:49.222314 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8efb7-beab-49e3-b314-3f831ba21dfe None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:49.261226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb69388-4d56-4b96-88b4-0d603173a24b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:49.329514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:49.330163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:49.330440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:49.330712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:49.331515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:49.331848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:49.333279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:49.356578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 359/703] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:49.368341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:49.383906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8efb7-beab-49e3-b314-3f831ba21dfe None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:49.448615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:49.449789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:49.450289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:49.450752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:49.470915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:49.472749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:49.482831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476077fa-d42d-493a-9bc6-9279e2e4c753 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:49.511396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:49.512321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:49.513166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:49.513166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:49.513166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:49.513166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:49.515407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 345/704] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:49.522051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:49.522850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:49.523131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:49.523427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:49.525144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:49.531062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:49.532655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:49.547717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:49.548674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:49.549579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 360/705] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:44:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:49.560226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:49.668099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298706e6-94dd-40e9-8533-0b44696c875b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:49.740130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:49.741222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:49.741698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:49.742161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:49.743137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:49.743712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:49.745652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:49.751615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b955-067e-497f-8b2a-981742a77863 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:49.778238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 346/706] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:49.783570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:49.793528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:49.794541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:49.795047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:49.795549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:49.797071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:49.797594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:49.799269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:49.820075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 361/707] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:44:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:49.825511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:49.977985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732579f1-c684-40a4-b0c6-eabff02ce343 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:49.982275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e087-6626-4c3a-a400-a4d0485aa07d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:50.015655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79beb8d-8879-45ab-bd35-5b4777e79519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:50.016332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79beb8d-8879-45ab-bd35-5b4777e79519 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.016614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79beb8d-8879-45ab-bd35-5b4777e79519 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.016887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79beb8d-8879-45ab-bd35-5b4777e79519 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.017769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79beb8d-8879-45ab-bd35-5b4777e79519 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:50.020067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79beb8d-8879-45ab-bd35-5b4777e79519 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:50.023026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0c1e-ae7a-499f-93e9-9ac551ad59e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:50.023928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0c1e-ae7a-499f-93e9-9ac551ad59e7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.024422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0c1e-ae7a-499f-93e9-9ac551ad59e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.024916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0c1e-ae7a-499f-93e9-9ac551ad59e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.048242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 347/708] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:44:49 2022] POST /identity/v3/users => generated 254 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:44:50.049769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fafca-956c-4c18-868a-1ea8f982e91c None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.050214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fafca-956c-4c18-868a-1ea8f982e91c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.051186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fafca-956c-4c18-868a-1ea8f982e91c None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.053038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 348/709] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:50.065421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827d6e-8ed7-4eb8-8bda-ebd990ea0551 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.066214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827d6e-8ed7-4eb8-8bda-ebd990ea0551 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.066642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827d6e-8ed7-4eb8-8bda-ebd990ea0551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.087776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-f2827d6e-8ed7-4eb8-8bda-ebd990ea0551 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:50.089505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f2827d6e-8ed7-4eb8-8bda-ebd990ea0551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:50.172266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 349/710] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:50.195805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb0c1e-ae7a-499f-93e9-9ac551ad59e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:50.197667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb0c1e-ae7a-499f-93e9-9ac551ad59e7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:50.240462 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2827d6e-8ed7-4eb8-8bda-ebd990ea0551 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:50.335236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 362/711] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:50.340563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0c1e-ae7a-499f-93e9-9ac551ad59e7 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:50.385073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2827d6e-8ed7-4eb8-8bda-ebd990ea0551 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:50.421605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:50.422498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.422778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.423052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] PATH_INFO: `/v3/services/network` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.423755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:50.425150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:50.439592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:50.440900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:50.443010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 350/712] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:50 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:50.451366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:50.470615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0c1e-ae7a-499f-93e9-9ac551ad59e7 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:50.511709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0e2cd-4852-4d36-af75-122a5fff31ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:50.512434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0e2cd-4852-4d36-af75-122a5fff31ba None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.512712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0e2cd-4852-4d36-af75-122a5fff31ba None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.512988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0e2cd-4852-4d36-af75-122a5fff31ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.527635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0e2cd-4852-4d36-af75-122a5fff31ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:50.529860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0e2cd-4852-4d36-af75-122a5fff31ba None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-33c0e2cd-4852-4d36-af75-122a5fff31ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:50.552829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:50.553793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:50.554680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:50.554680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:50.554680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:50.554680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:50.554918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 363/713] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:50.556197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04122550-4142-486e-96cd-d5de1ef0e34e None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.556492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04122550-4142-486e-96cd-d5de1ef0e34e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.556772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04122550-4142-486e-96cd-d5de1ef0e34e None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.558517 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 364/714] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:50.562398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04122550-4142-486e-96cd-d5de1ef0e34e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:50.569081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f941c1-2cfe-4388-aa9b-d0880e7d666f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:50.607722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74828b5b-c180-4c47-a104-d9d15da76ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:50.608404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828b5b-c180-4c47-a104-d9d15da76ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.608750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828b5b-c180-4c47-a104-d9d15da76ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.608956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828b5b-c180-4c47-a104-d9d15da76ba0 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.609672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74828b5b-c180-4c47-a104-d9d15da76ba0 None admin] RBAC: Adding query filter params (name=network) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:50.609981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74828b5b-c180-4c47-a104-d9d15da76ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:50.611374 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74828b5b-c180-4c47-a104-d9d15da76ba0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:50.617411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 351/715] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:44:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:50.622109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e9cb9-e62f-4d52-b3d5-71df9018290f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.622109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e9cb9-e62f-4d52-b3d5-71df9018290f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.622109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e9cb9-e62f-4d52-b3d5-71df9018290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.641938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c26e9cb9-e62f-4d52-b3d5-71df9018290f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:50.643458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c26e9cb9-e62f-4d52-b3d5-71df9018290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:50.695557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04122550-4142-486e-96cd-d5de1ef0e34e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:50.719245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 352/716] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:50.720549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e9cb9-e62f-4d52-b3d5-71df9018290f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:50.739830 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:50.740535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.740820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.741097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.741843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:50.742155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:50.744381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:50.759718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 365/717] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:50.760938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:50.856956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e9cb9-e62f-4d52-b3d5-71df9018290f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:50.881187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2999aa-c025-4858-af26-fb03b639061d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:50.893038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:50.893916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.894029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.894281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.894999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] RBAC: Adding query filter params (type=network) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:50.895398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:50.896907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:50.911575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 353/718] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:44:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:50.911575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:50.945804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c17dd4-2f2f-4510-9681-64841d537341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:50.946894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17dd4-2f2f-4510-9681-64841d537341 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.947347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17dd4-2f2f-4510-9681-64841d537341 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.947770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17dd4-2f2f-4510-9681-64841d537341 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.948684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c17dd4-2f2f-4510-9681-64841d537341 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:50.950776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c17dd4-2f2f-4510-9681-64841d537341 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:50.975790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 366/719] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:44:50 2022] POST /identity/v3/services => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:50.977361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c6d2-9d11-461c-a954-c1530ee13ecd None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.977696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c6d2-9d11-461c-a954-c1530ee13ecd None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.977973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c6d2-9d11-461c-a954-c1530ee13ecd None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:50.979675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 367/720] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:50.993255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495670c-bde3-41bf-a549-bd9b654b113e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:50.993622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495670c-bde3-41bf-a549-bd9b654b113e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:50.993808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495670c-bde3-41bf-a549-bd9b654b113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:51.032540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a495670c-bde3-41bf-a549-bd9b654b113e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:51.033777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a495670c-bde3-41bf-a549-bd9b654b113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:51.042835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acfb52-1e54-416b-8a57-44f1c2973f6e None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:51.104369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:51.105200 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:51.105480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:51.105750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:51.116678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:51.117767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:51.138543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:51.139518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:51.140393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 354/721] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:51.146546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:51.176670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 368/722] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:51.220564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495670c-bde3-41bf-a549-bd9b654b113e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:51.254388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38542c9-356c-4169-9b18-20ca3c77e8e0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:51.290109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:51.290780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:51.291065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:51.291377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:51.292173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:51.292483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:51.293918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:51.306442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 355/723] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:51.312251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:51.368707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495670c-bde3-41bf-a549-bd9b654b113e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:51.416730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fe720-c73f-4d13-bdb0-c5bde0cbeaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:51.417558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe720-c73f-4d13-bdb0-c5bde0cbeaa7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:51.417864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe720-c73f-4d13-bdb0-c5bde0cbeaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:51.418194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe720-c73f-4d13-bdb0-c5bde0cbeaa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:51.421320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab400-8ede-4059-b04d-0496eeb41cad None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:51.432860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fe720-c73f-4d13-bdb0-c5bde0cbeaa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-a41fe720-c73f-4d13-bdb0-c5bde0cbeaa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:51.440783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:51.442334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:51.443148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:51.447862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 369/724] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:51.448460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fe720-c73f-4d13-bdb0-c5bde0cbeaa7 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:51.463747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:51.464745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:51.465253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:51.465783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:51.466875 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:51.467414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:51.469057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:51.475502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 356/725] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:51 2022] GET /identity/v3/role_assignments?user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:51.559880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fe720-c73f-4d13-bdb0-c5bde0cbeaa7 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:51.598975 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:51.599679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:51.599957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:51.600226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:51.600977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:51.601276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:51.602667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:51.619961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 370/726] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:51.625651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:51.774971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1352d4-8c0a-4448-9e49-987c09a6b543 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:51.809653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:51.810832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:51.811334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:51.811838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:51.823282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:51.825051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:51.847346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:51.848789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:51.849702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:51.849702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:51.849702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:51.849702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:51.851998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 357/727] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:51.857244 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:51.995833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7540f-bfa1-4fa9-aa20-4aece087c925 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:52.031000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:52.032079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:52.032566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:52.033042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:52.033960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:52.034466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:52.036613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:52.048847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 371/728] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:52.054428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:52.166046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c4e0a-4959-45dc-8cd4-d06dfa5355fd None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:52.200859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:52.202044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:52.202531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:52.203006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:52.211963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:52.219332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:52.228546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:52.229439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:52.230343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 358/729] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:52.240385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:52.359417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ea2e-7c31-46fb-bfe3-324d808efb39 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:52.396982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:52.397946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:52.398230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:52.398512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:52.399383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:52.399689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:52.401144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:52.420410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 372/730] 10.222.0.93 () {56 vars in 1135 bytes} [Wed May 11 18:44:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:52.426386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:52.549413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eed09-c525-41e9-8f96-5b21cf58037b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:52.593854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c6de5-1e81-4375-9545-227924593312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:52.594911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6de5-1e81-4375-9545-227924593312 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:52.595412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6de5-1e81-4375-9545-227924593312 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:52.595879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6de5-1e81-4375-9545-227924593312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:52.678644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c6de5-1e81-4375-9545-227924593312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:52.680478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c6de5-1e81-4375-9545-227924593312 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:52.797069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 359/731] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 18:44:52.803025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:52.931736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b1e3-897b-4398-9ba1-dc03ade41174 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:52.931930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b1e3-897b-4398-9ba1-dc03ade41174 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:52.932203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b1e3-897b-4398-9ba1-dc03ade41174 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:52.934863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 360/732] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:44:52.938781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e190-4847-458d-8579-97967eeefde2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:52.939065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e190-4847-458d-8579-97967eeefde2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:52.939375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012e190-4847-458d-8579-97967eeefde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:52.958543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b012e190-4847-458d-8579-97967eeefde2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:52.959747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b012e190-4847-458d-8579-97967eeefde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:52.982939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75c95d-f3e7-49c1-93b4-4401b7528028 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:53.036164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 361/733] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 18:44:53.056934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:53.057734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.058014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.058311 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.058415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e190-4847-458d-8579-97967eeefde2 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:53.078922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:53.080764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:53.118273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:53.119217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:53.120800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:53.120800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:53.120800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:53.120800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:53.120800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 373/734] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:53.128246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:53.246606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff7a6a-6dcc-4157-b9a6-792eaab6ade9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:53.249769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012e190-4847-458d-8579-97967eeefde2 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:53.284321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:53.286141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.289307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.289844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.290772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:53.291322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:53.292902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:53.312918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 374/735] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:53.319751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:53.333033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283391c-c8ca-4a77-99eb-aaebe27b013f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:53.333915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283391c-c8ca-4a77-99eb-aaebe27b013f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.334131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283391c-c8ca-4a77-99eb-aaebe27b013f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.334404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283391c-c8ca-4a77-99eb-aaebe27b013f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.364297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283391c-c8ca-4a77-99eb-aaebe27b013f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-6283391c-c8ca-4a77-99eb-aaebe27b013f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:53.372165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:53.373151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:53.373996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 362/736] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:53.381290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283391c-c8ca-4a77-99eb-aaebe27b013f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:53.424849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c8cc-c750-4588-b697-deadf6c06b61 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:53.466834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:53.467995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.468488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.468954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.480710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:53.482410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:53.512687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:53.513634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:53.514527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 375/737] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:53.515024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283391c-c8ca-4a77-99eb-aaebe27b013f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:53.523062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:53.579523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:53.580206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.580482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.580750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.581506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:53.582372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:53.583807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:53.606977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 363/738] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:53.610101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:53.706937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b5a0-1e2e-4834-abb3-4e38006ca877 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:53.755355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99ce2c-4a88-4cd1-9635-df852e357005 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:53.771761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cdbae-578a-44d3-98b2-cb6decb48cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:53.772445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdbae-578a-44d3-98b2-cb6decb48cec None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.772721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdbae-578a-44d3-98b2-cb6decb48cec None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.772988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdbae-578a-44d3-98b2-cb6decb48cec None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.773789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdbae-578a-44d3-98b2-cb6decb48cec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:53.774093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdbae-578a-44d3-98b2-cb6decb48cec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:53.776388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdbae-578a-44d3-98b2-cb6decb48cec None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:53.790895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 376/739] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:53.793468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf504f-b7fc-4db6-bde7-ea2ea137d182 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.794007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf504f-b7fc-4db6-bde7-ea2ea137d182 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.794488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf504f-b7fc-4db6-bde7-ea2ea137d182 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.798508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 377/740] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:53.799411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf504f-b7fc-4db6-bde7-ea2ea137d182 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:53.811095 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65239157-04e8-4f69-995b-214f34869c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:53.812803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65239157-04e8-4f69-995b-214f34869c6a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.813309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65239157-04e8-4f69-995b-214f34869c6a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.813800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65239157-04e8-4f69-995b-214f34869c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.828838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65239157-04e8-4f69-995b-214f34869c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:53.831038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65239157-04e8-4f69-995b-214f34869c6a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-65239157-04e8-4f69-995b-214f34869c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:53.853718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:53.854692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:53.855584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:53.855584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:53.855584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:53.855584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:53.856665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 364/741] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:53.857887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64402-644b-4219-a0e7-85cb7f1aa88b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.858169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64402-644b-4219-a0e7-85cb7f1aa88b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.858439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64402-644b-4219-a0e7-85cb7f1aa88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.875650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9eb64402-644b-4219-a0e7-85cb7f1aa88b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:53.876628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9eb64402-644b-4219-a0e7-85cb7f1aa88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:53.926804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf504f-b7fc-4db6-bde7-ea2ea137d182 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:53.959627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 365/742] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 18:44:53.961368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64402-644b-4219-a0e7-85cb7f1aa88b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:53.975174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea076f03-aa74-4a0c-8098-0315bdb16dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:53.976218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea076f03-aa74-4a0c-8098-0315bdb16dde None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.976554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea076f03-aa74-4a0c-8098-0315bdb16dde None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.976873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea076f03-aa74-4a0c-8098-0315bdb16dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.977879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea076f03-aa74-4a0c-8098-0315bdb16dde None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=d0583c8ab3414ff6b70acf6267ef0d25) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:53.978596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea076f03-aa74-4a0c-8098-0315bdb16dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:53.980538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea076f03-aa74-4a0c-8098-0315bdb16dde None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:53.986404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 378/743] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:53 2022] GET /identity/v3/role_assignments?user.id=d0583c8ab3414ff6b70acf6267ef0d25&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:53.988394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9aa1-d5a1-42cf-97b1-e0ea621561e5 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:53.988394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9aa1-d5a1-42cf-97b1-e0ea621561e5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:53.988667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9aa1-d5a1-42cf-97b1-e0ea621561e5 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:53.994287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 379/744] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:53.995164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a9aa1-d5a1-42cf-97b1-e0ea621561e5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:54.084051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64402-644b-4219-a0e7-85cb7f1aa88b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:54.111952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a9aa1-d5a1-42cf-97b1-e0ea621561e5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:54.125625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a2716-6907-4e6f-b2e3-73e3f40480a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:54.126447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a2716-6907-4e6f-b2e3-73e3f40480a8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.126800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a2716-6907-4e6f-b2e3-73e3f40480a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.127256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a2716-6907-4e6f-b2e3-73e3f40480a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.128621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a2716-6907-4e6f-b2e3-73e3f40480a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:54.128942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a2716-6907-4e6f-b2e3-73e3f40480a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:54.130717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a2716-6907-4e6f-b2e3-73e3f40480a8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:54.151403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 366/745] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:54.155979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf08b3-8ff8-41dd-93bf-1de10802cc31 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.155979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf08b3-8ff8-41dd-93bf-1de10802cc31 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.156289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6dc7-61a8-48c3-9b04-1f539ba45ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:54.156395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf08b3-8ff8-41dd-93bf-1de10802cc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.156477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6dc7-61a8-48c3-9b04-1f539ba45ba7 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.156477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6dc7-61a8-48c3-9b04-1f539ba45ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.156477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6dc7-61a8-48c3-9b04-1f539ba45ba7 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.156477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac6dc7-61a8-48c3-9b04-1f539ba45ba7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:54.157705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac6dc7-61a8-48c3-9b04-1f539ba45ba7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:54.173488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-efcf08b3-8ff8-41dd-93bf-1de10802cc31 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:54.173944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 380/746] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:44:53 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:54.174965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6dc7-61a8-48c3-9b04-1f539ba45ba7 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:54.175881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-efcf08b3-8ff8-41dd-93bf-1de10802cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:54.282421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 367/747] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:44:54.303716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6dc7-61a8-48c3-9b04-1f539ba45ba7 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:54.308447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf08b3-8ff8-41dd-93bf-1de10802cc31 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:54.362550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2727-a762-4453-b10b-e8946a0fe19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:54.364200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2727-a762-4453-b10b-e8946a0fe19c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.364827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2727-a762-4453-b10b-e8946a0fe19c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.365115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2727-a762-4453-b10b-e8946a0fe19c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.375961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b2727-a762-4453-b10b-e8946a0fe19c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:54.377731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b2727-a762-4453-b10b-e8946a0fe19c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-797b2727-a762-4453-b10b-e8946a0fe19c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:54.394706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:54.396566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:44:54.397483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:54.399742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 381/748] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:44:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:54.401178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9057924-f1fe-47ac-9a96-0ab1d0d309b3 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.401487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9057924-f1fe-47ac-9a96-0ab1d0d309b3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.401759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9057924-f1fe-47ac-9a96-0ab1d0d309b3 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.407332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 382/749] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:54.407332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9057924-f1fe-47ac-9a96-0ab1d0d309b3 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:54.443055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf08b3-8ff8-41dd-93bf-1de10802cc31 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:54.479989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13070b38-fc01-489d-a08c-3dc384e52e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:54.480361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070b38-fc01-489d-a08c-3dc384e52e8c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.480554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070b38-fc01-489d-a08c-3dc384e52e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.481609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070b38-fc01-489d-a08c-3dc384e52e8c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.481609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13070b38-fc01-489d-a08c-3dc384e52e8c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:54.482900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13070b38-fc01-489d-a08c-3dc384e52e8c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-13070b38-fc01-489d-a08c-3dc384e52e8c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:54.497551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:54.498672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:54.499790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:54.503702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 368/750] 10.222.0.93 () {56 vars in 1129 bytes} [Wed May 11 18:44:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:54.505065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e341c4-185f-44a3-8b94-c0bf69359fec None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.505438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e341c4-185f-44a3-8b94-c0bf69359fec None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.505779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e341c4-185f-44a3-8b94-c0bf69359fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.522586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-32e341c4-185f-44a3-8b94-c0bf69359fec None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:54.523901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-32e341c4-185f-44a3-8b94-c0bf69359fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:54.529662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9057924-f1fe-47ac-9a96-0ab1d0d309b3 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:54.575701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:54.576378 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.576656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.576928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.577771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:54.578080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:54.579738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:54.598652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 369/751] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:44:54.603005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 383/752] 10.222.0.93 () {56 vars in 1149 bytes} [Wed May 11 18:44:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:54.603610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e341c4-185f-44a3-8b94-c0bf69359fec None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:54.609700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:54.721087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e341c4-185f-44a3-8b94-c0bf69359fec None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:54.733848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d63c6c-d3e9-447b-8bb9-135020b1fe7b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:54.757704 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:54.758707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.759666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.760274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.761319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:54.761992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:54.764119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:54.771518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 370/753] 10.222.0.93 () {56 vars in 1124 bytes} [Wed May 11 18:44:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:54.772586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:54.778174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254834d5-0159-4a8b-bc0c-a4eb8b23abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:54.778831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254834d5-0159-4a8b-bc0c-a4eb8b23abf0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.779111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254834d5-0159-4a8b-bc0c-a4eb8b23abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.779410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254834d5-0159-4a8b-bc0c-a4eb8b23abf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.868105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254834d5-0159-4a8b-bc0c-a4eb8b23abf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:54.870332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254834d5-0159-4a8b-bc0c-a4eb8b23abf0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:54.874530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec821-29ce-4853-8ef5-b39955d0bfad None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:54.909047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ccf79-b52c-4fb5-9df1-47b517e62ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:54.909899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf79-b52c-4fb5-9df1-47b517e62ce0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:54.910181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf79-b52c-4fb5-9df1-47b517e62ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:54.910449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf79-b52c-4fb5-9df1-47b517e62ce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:54.921056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ccf79-b52c-4fb5-9df1-47b517e62ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-878ccf79-b52c-4fb5-9df1-47b517e62ce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:54.929502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:54.930397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:54.931212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:54.935718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 371/754] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:54.936509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ccf79-b52c-4fb5-9df1-47b517e62ce0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:54.991039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 384/755] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:44:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:44:54.992275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254834d5-0159-4a8b-bc0c-a4eb8b23abf0 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.038866 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ccf79-b52c-4fb5-9df1-47b517e62ce0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.077638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.079053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.079380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.079630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.080339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:55.080644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.082087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.088603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 372/756] 10.222.0.93 () {56 vars in 1124 bytes} [Wed May 11 18:44:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:55.089383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.108541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254834d5-0159-4a8b-bc0c-a4eb8b23abf0 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.145005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.145681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.145961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.146231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.146974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:55.147276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.148676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.161772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 385/757] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:55.162637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.214086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb6d63-2c4c-4504-ac38-4227d7d598ad None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.247703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.248420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.249027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.249027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.260291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.261777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.279386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a6579-b5db-466f-b833-6dd40669806c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:55.280420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:55.281250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:55.282120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:55.282120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:55.282120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:55.282120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:55.282120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 373/758] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:55.282884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.324734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.325983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.326416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.327126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.328388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] RBAC: Adding query filter params (interface=public, service_id=bdab44ca3fb04d9b87d19465672ca32d, region_id=RegionOne) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:55.328846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.330918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.341873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 386/759] 10.222.0.93 () {56 vars in 1251 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/endpoints?service_id=bdab44ca3fb04d9b87d19465672ca32d&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:55.343456 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.393746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b949-162d-464f-9c40-0668e5a40ee9 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.440097 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.442053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.442646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.443070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.452223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a9ea-fd8d-487d-8727-f59b5023b265 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.457807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.459457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:55.480391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:55.481491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:55.482546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:55.482546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:55.482546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:55.482546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:55.484163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 374/760] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:55.485080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.494252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.495112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.495586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.496421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.497171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:55.497476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.499290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.511505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 387/761] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:55.512325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.593088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c37018-adeb-487e-b41a-4af8afecb0b1 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.612425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad600787-affe-4c4c-b289-120330a6b4cd None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.626500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09e9b5-c7e2-466d-9ac6-c1e571607480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.627353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09e9b5-c7e2-466d-9ac6-c1e571607480 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.627701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09e9b5-c7e2-466d-9ac6-c1e571607480 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.628041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09e9b5-c7e2-466d-9ac6-c1e571607480 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.628850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09e9b5-c7e2-466d-9ac6-c1e571607480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.630288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09e9b5-c7e2-466d-9ac6-c1e571607480 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.635724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 375/762] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:55.636633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09e9b5-c7e2-466d-9ac6-c1e571607480 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.648231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.648912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.649193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.649466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.650190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:55.650495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.651900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.664672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 388/763] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:55.669875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.795366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170abcd-dd51-4f67-bcef-586dbf4ae410 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.836754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.837565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.837844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.838118 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.846840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.849352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:55.866746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:55.867794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:55.869344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 389/764] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:55.873639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.874898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09e9b5-c7e2-466d-9ac6-c1e571607480 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:55.941515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:55.942696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:55.943202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:55.943767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:55.951262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:55.953036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:55.968905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:55.969827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:55.970736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:55.970736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:55.970736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:55.970736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:55.970736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:55.970736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:55.970736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:55.970736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:55.978158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 376/765] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:55.979681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:55.985804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d3f5d-7347-4618-82fa-b96f29b10ce9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:56.031875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:56.033391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.033922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.034494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.035605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:56.036119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:56.037795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:56.057042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 390/766] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:56.062503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:56.100459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29156507-bacd-45f9-b8a2-8689c516337c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:56.160788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:56.162002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.162861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.163532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.164532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:56.165056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:56.166817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:56.184537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 377/767] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:56.187533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:56.209506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e9392-69ea-444a-9f53-3587a1b06c19 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:56.281032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:56.281838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.282119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.282394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.306855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:56.311467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:56.345396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:56.346334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:56.347238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:56.347238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:56.347238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:56.347238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:56.354278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c3ae-c16f-45da-9a5d-fdc1756e90f6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:56.356797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 391/768] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:56.358140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:56.414903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b406764-ba59-420b-9f48-cf359510b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:56.415937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406764-ba59-420b-9f48-cf359510b974 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.416398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406764-ba59-420b-9f48-cf359510b974 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.417341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b406764-ba59-420b-9f48-cf359510b974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.418944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b406764-ba59-420b-9f48-cf359510b974 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=ee6716ed4ede4bd1819991a607eef29f) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:56.419463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b406764-ba59-420b-9f48-cf359510b974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:56.421289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b406764-ba59-420b-9f48-cf359510b974 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:56.435714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 378/769] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:44:56 2022] GET /identity/v3/role_assignments?user.id=ee6716ed4ede4bd1819991a607eef29f&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:56.518448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6170a73-79fb-4aa4-a4fa-3d2e39a4e5ce None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.518733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6170a73-79fb-4aa4-a4fa-3d2e39a4e5ce None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.519566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6170a73-79fb-4aa4-a4fa-3d2e39a4e5ce None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.521224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 379/770] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:44:56.526991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03f4f-0561-452e-b359-74f065d696d9 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.527277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03f4f-0561-452e-b359-74f065d696d9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.527616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03f4f-0561-452e-b359-74f065d696d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.546103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7ce03f4f-0561-452e-b359-74f065d696d9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:56.547342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7ce03f4f-0561-452e-b359-74f065d696d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:56.587493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c243ff6-4286-4d4f-ab67-ea6b5960d75f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:56.621976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 380/771] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:44:56.632112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd364-72cb-406e-bcdc-949df8198e2b None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.632450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd364-72cb-406e-bcdc-949df8198e2b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.632684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd364-72cb-406e-bcdc-949df8198e2b None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.634332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 381/772] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:56.642830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff66a-a76f-462d-a17d-941785b77a8b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.643124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff66a-a76f-462d-a17d-941785b77a8b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.643443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff66a-a76f-462d-a17d-941785b77a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.663220 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:56.663963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.664254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.664533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.665326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:56.665634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:56.667090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:56.667197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a8dff66a-a76f-462d-a17d-941785b77a8b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:56.668576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a8dff66a-a76f-462d-a17d-941785b77a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:56.682804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 392/773] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:56.684038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:56.759328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 382/774] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:44:56.760563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff66a-a76f-462d-a17d-941785b77a8b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:56.806862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c1a3-ba4c-4c2e-b0ae-ed8277636a40 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:56.858308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de3d75-0ea4-4b5d-80bb-120fcf2d4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:56.859162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3d75-0ea4-4b5d-80bb-120fcf2d4d45 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:56.859576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3d75-0ea4-4b5d-80bb-120fcf2d4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:56.859924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3d75-0ea4-4b5d-80bb-120fcf2d4d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:56.872918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de3d75-0ea4-4b5d-80bb-120fcf2d4d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-73de3d75-0ea4-4b5d-80bb-120fcf2d4d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:56.881053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:56.882027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:56.882844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 393/775] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:56.888577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de3d75-0ea4-4b5d-80bb-120fcf2d4d45 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.005438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de3d75-0ea4-4b5d-80bb-120fcf2d4d45 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.015864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff66a-a76f-462d-a17d-941785b77a8b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.039392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.040195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.040474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.040746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] PATH_INFO: `/v3/services/network` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.041390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.042847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.051317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.052286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.052713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.053149 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:57.055344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:57.056499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:57.057348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 394/776] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:56 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:57.058121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.063559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.065442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:57.079607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:57.080583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:57.081435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:57.081435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:57.081435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:57.081435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:57.081435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:57.081435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:57.081435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:57.081435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:57.088734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 383/777] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:57.089797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.169572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65969b-33c1-48a9-8498-ded57c3f8d49 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.204043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7e37b-5a45-4a11-a4df-4636faab6f17 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.211650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.212434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.212815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.213809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.214695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:57.215098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.217355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.228601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 395/778] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:57.229937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.250926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.251943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.253758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.254641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.255871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] RBAC: Adding query filter params (name=network) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:57.256333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.261853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.270606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 384/779] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:57.271827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.380031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6233206-323d-465d-bf68-f36a78d3a498 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.381290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aa97f-85fc-4365-a84a-c7e7b1948ac5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.414403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.415916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.416440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.417057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.422798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.423430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.423716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.424050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.424844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:57.425155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.427140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.430203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.431947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.446722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 396/780] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:57.446722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:57.456047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:57.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:57.457929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:57.457929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:57.457929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:57.457929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:57.462571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 385/781] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:57.463478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.551700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b054fe-b54f-4b04-9a07-3721c4f6e594 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.584106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916fa16-69fc-4c83-80b9-7a7d445c89d6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.593135 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.593802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.594100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.594725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.595466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] RBAC: Adding query filter params (type=network) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:57.595778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.598319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.604802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 397/782] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:57.605693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.626477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f77a1-4f46-4fc6-92c3-ba3654f09ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.627813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f77a1-4f46-4fc6-92c3-ba3654f09ce5 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.628111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f77a1-4f46-4fc6-92c3-ba3654f09ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.628426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f77a1-4f46-4fc6-92c3-ba3654f09ce5 None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/aaff3fdfbc054b8f86a2f9aaa98a70cc/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.630625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f77a1-4f46-4fc6-92c3-ba3654f09ce5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=aaff3fdfbc054b8f86a2f9aaa98a70cc, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.632810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f77a1-4f46-4fc6-92c3-ba3654f09ce5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.659453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 386/783] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:44:57 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/aaff3fdfbc054b8f86a2f9aaa98a70cc/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:57.661329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f77a1-4f46-4fc6-92c3-ba3654f09ce5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.732014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93ddfb-611f-44bd-b318-0041cbf5879c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.775646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.776331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.776675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.776952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.777736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:57.778103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.779540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.798915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 398/784] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:57.800376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:57.886553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f77a1-4f46-4fc6-92c3-ba3654f09ce5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.949830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:57.950874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:57.951381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:57.952490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:57.953479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] RBAC: Adding query filter params (interface=public, service_id=620d1d6753d140c7a7c66c8ca8ed0f66, region_id=RegionOne) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:57.954135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:57.958175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:57.962813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446b82-f739-4e88-8e86-5a80255f0ecf None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:57.968473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 387/785] 10.222.0.93 () {56 vars in 1251 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/endpoints?service_id=620d1d6753d140c7a7c66c8ca8ed0f66&interface=public®ion_id=RegionOne => generated 194 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:57.973828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:58.000331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:58.001369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.001860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.002327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.011398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:58.013165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:44:58.029079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:58.030027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 18:44:58.030974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:58.033816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 399/786] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:58.041341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:58.102985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac67a-2eaf-433e-8bcc-d84d2de60527 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:58.144009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa42ec-9d21-4602-8869-3f27ff478854 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:58.157452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a929dc-6d9a-4f0a-950b-0502f24fb2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:58.158146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a929dc-6d9a-4f0a-950b-0502f24fb2d0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.158426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a929dc-6d9a-4f0a-950b-0502f24fb2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.158700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a929dc-6d9a-4f0a-950b-0502f24fb2d0 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.159437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a929dc-6d9a-4f0a-950b-0502f24fb2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:58.161396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a929dc-6d9a-4f0a-950b-0502f24fb2d0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:58.174366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 388/787] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:44:57 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:58.199767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d18f9a-1e2b-4b25-b6c0-f3ac4d97b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:58.200466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d18f9a-1e2b-4b25-b6c0-f3ac4d97b683 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.200754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d18f9a-1e2b-4b25-b6c0-f3ac4d97b683 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.201032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d18f9a-1e2b-4b25-b6c0-f3ac4d97b683 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.201904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d18f9a-1e2b-4b25-b6c0-f3ac4d97b683 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:58.202215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d18f9a-1e2b-4b25-b6c0-f3ac4d97b683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:58.203754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d18f9a-1e2b-4b25-b6c0-f3ac4d97b683 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:58.227446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 400/788] 10.222.0.93 () {56 vars in 1135 bytes} [Wed May 11 18:44:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:58.229669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a929dc-6d9a-4f0a-950b-0502f24fb2d0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:58.336347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a929dc-6d9a-4f0a-950b-0502f24fb2d0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:58.369548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee37f5-f39b-4840-acdf-bbc9d7b108d7 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.369869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee37f5-f39b-4840-acdf-bbc9d7b108d7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.370108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee37f5-f39b-4840-acdf-bbc9d7b108d7 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.371833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 401/789] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:44:58.377680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6991-3916-4573-9268-9f1a2d96794d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.378004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6991-3916-4573-9268-9f1a2d96794d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.378165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:58.378278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6991-3916-4573-9268-9f1a2d96794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.379506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.379791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.380067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.395217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:58.396726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:58.408465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3bdf6991-3916-4573-9268-9f1a2d96794d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:58.409742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3bdf6991-3916-4573-9268-9f1a2d96794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:44:58.417756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:58.419264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:58.420372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:44:58.420372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:44:58.420372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:44:58.420372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:58.423408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 389/790] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:58.427026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:58.500347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 402/791] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:44:58.524215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf6991-3916-4573-9268-9f1a2d96794d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:58.553849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6199a-fcd8-42fa-beef-8b01d0273acc None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:58.607774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:58.608829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.609334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.609808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.610735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:58.611245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:58.613435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:58.638117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 390/792] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:44:58.653952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf6991-3916-4573-9268-9f1a2d96794d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:58.660757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:58.726610 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:58.727824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.728344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.728818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.729744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:58.731407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:58.745063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:58.746065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 18:44:58.746888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:58.749942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 403/793] 10.222.0.93 () {56 vars in 1129 bytes} [Wed May 11 18:44:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:58.760396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:58.844203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0fe9-77f0-4f8d-9f93-7e0f662065d1 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:58.906466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:58.907182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:58.907484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:58.907753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:58.917065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:58.918531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:44:58.944578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:58.945512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:58.946364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:44:58.946364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:44:58.946364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:44:58.946364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:44:58.946364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:44:58.946364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:44:58.946364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:44:58.946364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:44:58.946783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 391/794] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:44:58.951562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:58.956199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119ec1-c321-4210-b7ff-6de6bf0ae18b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:59.005616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc28a4-8a28-4b70-a816-1c5421feacad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:59.006285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc28a4-8a28-4b70-a816-1c5421feacad None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.006564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc28a4-8a28-4b70-a816-1c5421feacad None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.006840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc28a4-8a28-4b70-a816-1c5421feacad None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.008524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc28a4-8a28-4b70-a816-1c5421feacad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:59.008839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc28a4-8a28-4b70-a816-1c5421feacad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:59.010215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc28a4-8a28-4b70-a816-1c5421feacad None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:59.019752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 404/795] 10.222.0.93 () {56 vars in 1124 bytes} [Wed May 11 18:44:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:59.021263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b5b5-3195-4985-bb75-80edc7b43243 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.021555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b5b5-3195-4985-bb75-80edc7b43243 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.021831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b5b5-3195-4985-bb75-80edc7b43243 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.023249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 405/796] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:44:59.024925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b5b5-3195-4985-bb75-80edc7b43243 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:59.089363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1e553-4fe1-4f96-a256-a17bbe6e8917 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:59.123243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa5e56-a378-445a-a74f-dcb3010aace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:59.123702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5e56-a378-445a-a74f-dcb3010aace6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.123985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5e56-a378-445a-a74f-dcb3010aace6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.124254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5e56-a378-445a-a74f-dcb3010aace6 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.125088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa5e56-a378-445a-a74f-dcb3010aace6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:59.125352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa5e56-a378-445a-a74f-dcb3010aace6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:59.126776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa5e56-a378-445a-a74f-dcb3010aace6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:59.143510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 392/797] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:59.144864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c413cdc-4fa3-4d95-9f88-a845a7706a1b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.145148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c413cdc-4fa3-4d95-9f88-a845a7706a1b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.145421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c413cdc-4fa3-4d95-9f88-a845a7706a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.149557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b5b5-3195-4985-bb75-80edc7b43243 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:59.163309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-8c413cdc-4fa3-4d95-9f88-a845a7706a1b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:44:59.164547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8c413cdc-4fa3-4d95-9f88-a845a7706a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:44:59.192774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:59.194046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.194713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.201057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.205067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:59.205067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:59.205427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:59.219285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 406/798] 10.222.0.93 () {56 vars in 1124 bytes} [Wed May 11 18:44:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:59.219285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:59.263752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 393/799] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:44:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:44:59.266230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c413cdc-4fa3-4d95-9f88-a845a7706a1b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:59.338085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801dfc-d39a-47b8-bf4b-0a785c535cf3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:59.385551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211a05f-3cd5-4630-9f1f-2f1cc72b788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:59.387056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211a05f-3cd5-4630-9f1f-2f1cc72b788c None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.390479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211a05f-3cd5-4630-9f1f-2f1cc72b788c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.391243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211a05f-3cd5-4630-9f1f-2f1cc72b788c None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/d0583c8ab3414ff6b70acf6267ef0d25/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.396733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211a05f-3cd5-4630-9f1f-2f1cc72b788c None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=d0583c8ab3414ff6b70acf6267ef0d25, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:59.398705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211a05f-3cd5-4630-9f1f-2f1cc72b788c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:59.399126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c413cdc-4fa3-4d95-9f88-a845a7706a1b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:59.417359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 407/800] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:44:59 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/d0583c8ab3414ff6b70acf6267ef0d25/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:44:59.418652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211a05f-3cd5-4630-9f1f-2f1cc72b788c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:59.438155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f4fb-5ae8-4d42-ba1e-edf70ba3ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:59.438890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f4fb-5ae8-4d42-ba1e-edf70ba3ca64 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.439677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f4fb-5ae8-4d42-ba1e-edf70ba3ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.440256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f4fb-5ae8-4d42-ba1e-edf70ba3ca64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.441047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1f4fb-5ae8-4d42-ba1e-edf70ba3ca64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:59.442758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1f4fb-5ae8-4d42-ba1e-edf70ba3ca64 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:59.482436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 394/801] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:44:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:44:59.556010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211a05f-3cd5-4630-9f1f-2f1cc72b788c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:59.599983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55c22d-353d-4255-84a5-91065d73d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:59.600811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55c22d-353d-4255-84a5-91065d73d84e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.601088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55c22d-353d-4255-84a5-91065d73d84e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.601356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55c22d-353d-4255-84a5-91065d73d84e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.613960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55c22d-353d-4255-84a5-91065d73d84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-cb55c22d-353d-4255-84a5-91065d73d84e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:44:59.622076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:44:59.623097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:44:59.623989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 408/802] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:44:59.631692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f4fb-5ae8-4d42-ba1e-edf70ba3ca64 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:59.754105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f4fb-5ae8-4d42-ba1e-edf70ba3ca64 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:59.790286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:59.791365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.791867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.792355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.793293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:44:59.793796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:59.795451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:44:59.804511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 395/803] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:44:59.810460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55c22d-353d-4255-84a5-91065d73d84e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:44:59.927675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55c22d-353d-4255-84a5-91065d73d84e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:44:59.971013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:44:59.971856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:44:59.972170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:44:59.972445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:44:59.983859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:44:59.985336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:00.007565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:00.008445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:00.009317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:00.009317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:00.009317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:00.009317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:00.010914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 409/804] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:00.015689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:00.153315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872e43b-ab00-4d79-9145-48290e39d100 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:00.194874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:00.201258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:00.207248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:00.207827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:00.208790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:00.209307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:00.210890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:00.228617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 396/805] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:00.234466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:00.399603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f6c6-34bc-4960-a8a5-01267451c1a6 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:00.441386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb2afa-a4b8-4f1f-9506-0fc0408282db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:00.442298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb2afa-a4b8-4f1f-9506-0fc0408282db None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:00.442582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb2afa-a4b8-4f1f-9506-0fc0408282db None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:00.442856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb2afa-a4b8-4f1f-9506-0fc0408282db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:00.451911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb2afa-a4b8-4f1f-9506-0fc0408282db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:00.453367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb2afa-a4b8-4f1f-9506-0fc0408282db None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-eabb2afa-a4b8-4f1f-9506-0fc0408282db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:00.469746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:00.471674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:00.474151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 410/806] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:45:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:00.483991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:00.584080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a689d8-6db1-442e-b350-094a18d634d4 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:00.584680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a689d8-6db1-442e-b350-094a18d634d4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:00.584680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a689d8-6db1-442e-b350-094a18d634d4 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:00.587150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 411/807] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:00.590982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be804e-7c46-49c7-96cb-971ebb381aee None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:00.591274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be804e-7c46-49c7-96cb-971ebb381aee None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:00.591579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be804e-7c46-49c7-96cb-971ebb381aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:00.607977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a225f-2d30-4cd8-907f-e1b2753d889b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:00.624318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e3be804e-7c46-49c7-96cb-971ebb381aee None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:00.625519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e3be804e-7c46-49c7-96cb-971ebb381aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:00.652335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:00.652928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:00.653272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:00.653547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:00.654451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:00.654762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:00.657482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:00.694471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 397/808] 10.222.0.93 () {56 vars in 1149 bytes} [Wed May 11 18:45:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:00.709277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:00.770216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 412/809] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:00.815574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be804e-7c46-49c7-96cb-971ebb381aee None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:00.835338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cad68-668e-44a7-a8e3-ce49fda263db None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:00.872488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:00.873285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:00.873564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:00.873837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:00.891144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:00.898575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:00.930982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:00.931960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:00.932921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:00.932921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:00.932921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:00.932921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:00.937064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 398/810] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:00.945154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.019870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be804e-7c46-49c7-96cb-971ebb381aee None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.069964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2b7ae-5431-4796-8fdc-51821d98102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.071372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2b7ae-5431-4796-8fdc-51821d98102b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.071669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2b7ae-5431-4796-8fdc-51821d98102b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.071918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2b7ae-5431-4796-8fdc-51821d98102b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.085048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2b7ae-5431-4796-8fdc-51821d98102b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-a6d2b7ae-5431-4796-8fdc-51821d98102b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:01.096347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:01.100371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:01.102217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:01.103488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e214-1dd3-4814-8ab9-9a5210c62eff None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.103639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 413/811] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:01.103639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524df1e-d22f-4f84-8907-94ccf517f465 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.103639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524df1e-d22f-4f84-8907-94ccf517f465 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.103639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524df1e-d22f-4f84-8907-94ccf517f465 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.103639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 414/812] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:01.104297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524df1e-d22f-4f84-8907-94ccf517f465 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.152955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffc676-409c-46a1-9723-94b828a5bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.153658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffc676-409c-46a1-9723-94b828a5bf34 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.153939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffc676-409c-46a1-9723-94b828a5bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.154213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffc676-409c-46a1-9723-94b828a5bf34 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.154941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffc676-409c-46a1-9723-94b828a5bf34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:01.155247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffc676-409c-46a1-9723-94b828a5bf34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:01.156657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffc676-409c-46a1-9723-94b828a5bf34 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:01.170932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 399/813] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:01.172467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff61e-8f23-4953-b828-e66b0395b8a7 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.172760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff61e-8f23-4953-b828-e66b0395b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.173039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff61e-8f23-4953-b828-e66b0395b8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.193195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ab7ff61e-8f23-4953-b828-e66b0395b8a7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:01.194337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ab7ff61e-8f23-4953-b828-e66b0395b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:01.247888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524df1e-d22f-4f84-8907-94ccf517f465 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.286439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 400/814] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:01.287476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ff61e-8f23-4953-b828-e66b0395b8a7 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.307590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.308024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.308358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.308633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.309437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:01.309741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:01.311187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:01.322652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 415/815] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:01.324109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.432604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a8402-4e74-46f3-854b-e1783dd9ecb7 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.434372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ff61e-8f23-4953-b828-e66b0395b8a7 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.468808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.469531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.469815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.470091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] PATH_INFO: `/v3/services/network` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.470742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:01.471654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.472291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:01.472664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.473008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.473345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.482213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:01.483798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:01.486849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:01.488574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 18:45:01.489419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:01.496828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 416/816] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:01 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:01.497845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:01.500012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:01.501366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:01.502432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:01.502432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:01.502432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:01.502432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:01.502432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:01.502432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:01.502432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:01.502432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:01.503015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 401/817] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:01.503890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.625599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0833-2530-40b7-abf5-8aee99eb1062 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.632665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51224d6-466f-443b-aa16-174906456a9c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.668989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.669656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.669945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.670202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.670912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] RBAC: Adding query filter params (name=network) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:01.671216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:01.672694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:01.673843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.675811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.676579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.677082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.682417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 402/818] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:01.682417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.697484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:01.699816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:01.723218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:01.724154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:01.725108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:01.725108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:01.725108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:01.725108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:01.727222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 417/819] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:01.728508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.814206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac21d-dbe5-4a56-89eb-9cfe829acbcf None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.847371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5f1a5-5ac8-4a34-a018-7304d1175f22 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:01.850748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.851656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.852122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.852600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.853585 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:01.854075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:01.855732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:01.868640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 403/820] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:01.869896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.887940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:01.888627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:01.889038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:01.889320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:01.890318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] RBAC: Adding query filter params (type=network) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:01.890643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:01.892047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:01.898866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 418/821] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:01.900057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:01.978024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec000c4-a942-44a9-868d-aa26e467a9a5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:02.022317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:02.022993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.023272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.023579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.024828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:02.025272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:02.026639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:02.027568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0138-5af5-4b3d-84f6-61771ec8e752 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:02.043506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 404/822] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:02.045383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:02.072855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659be7c-bbdb-4208-bf18-f1207e5fc69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:02.073909 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659be7c-bbdb-4208-bf18-f1207e5fc69f None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.074189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659be7c-bbdb-4208-bf18-f1207e5fc69f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.074463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659be7c-bbdb-4208-bf18-f1207e5fc69f None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/ee6716ed4ede4bd1819991a607eef29f/roles/e46746a1257a4ec8a138a0a31e80a8da` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.092905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659be7c-bbdb-4208-bf18-f1207e5fc69f None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=ee6716ed4ede4bd1819991a607eef29f, role_id=e46746a1257a4ec8a138a0a31e80a8da)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:02.094555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659be7c-bbdb-4208-bf18-f1207e5fc69f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:02.112540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 419/823] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:45:01 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/ee6716ed4ede4bd1819991a607eef29f/roles/e46746a1257a4ec8a138a0a31e80a8da => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:45:02.114035 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659be7c-bbdb-4208-bf18-f1207e5fc69f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:02.198109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ce360-c745-40ee-8201-ec5933a33d15 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:02.252388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659be7c-bbdb-4208-bf18-f1207e5fc69f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:02.290744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fa543-7fd3-4262-9634-99de9458ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:02.290955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57768a1f-3c69-492f-94cc-1b629d2bd42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:02.292108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa543-7fd3-4262-9634-99de9458ddec None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.292615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa543-7fd3-4262-9634-99de9458ddec None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.293090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa543-7fd3-4262-9634-99de9458ddec None admin] PATH_INFO: `/v3/users/nova` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.295674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57768a1f-3c69-492f-94cc-1b629d2bd42f None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.296244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57768a1f-3c69-492f-94cc-1b629d2bd42f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.296739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57768a1f-3c69-492f-94cc-1b629d2bd42f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.297737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57768a1f-3c69-492f-94cc-1b629d2bd42f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:02.299409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57768a1f-3c69-492f-94cc-1b629d2bd42f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:02.308103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fa543-7fd3-4262-9634-99de9458ddec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:02.310022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fa543-7fd3-4262-9634-99de9458ddec None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-130fa543-7fd3-4262-9634-99de9458ddec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:02.326623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:02.327846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:45:02.328843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:02.331925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 420/824] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:45:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:02.333514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fbb1-61f0-4f36-be46-9d84649fa746 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.333800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fbb1-61f0-4f36-be46-9d84649fa746 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.334149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fbb1-61f0-4f36-be46-9d84649fa746 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.339435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 421/825] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:02.339435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8fbb1-61f0-4f36-be46-9d84649fa746 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:02.348942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 405/826] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:45:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:45:02.350290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec045-497d-4297-8a24-2b2bf6712bb6 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.350576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec045-497d-4297-8a24-2b2bf6712bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.350851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec045-497d-4297-8a24-2b2bf6712bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.369457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b40ec045-497d-4297-8a24-2b2bf6712bb6 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:02.370657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b40ec045-497d-4297-8a24-2b2bf6712bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:02.474627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 406/827] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:02.477277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2817-c72b-4e22-9ebb-b2bd280cec54 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.477277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2817-c72b-4e22-9ebb-b2bd280cec54 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.477277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2817-c72b-4e22-9ebb-b2bd280cec54 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.479492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 407/828] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:02.489194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8fbb1-61f0-4f36-be46-9d84649fa746 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:02.493013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29d20-28fc-46d9-9d49-7bbb7071723f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.493299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29d20-28fc-46d9-9d49-7bbb7071723f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.493574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29d20-28fc-46d9-9d49-7bbb7071723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.519664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-91d29d20-28fc-46d9-9d49-7bbb7071723f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:02.521358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-91d29d20-28fc-46d9-9d49-7bbb7071723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:02.538591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:02.539282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.539782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.540058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.541463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:02.541924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:02.543932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:02.568722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 422/829] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:45:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:02.569596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:02.612831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 408/830] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:02.627329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29d20-28fc-46d9-9d49-7bbb7071723f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:02.691850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9252ce-72f3-4012-a6c1-bfe9d19826d3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:02.720199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29d20-28fc-46d9-9d49-7bbb7071723f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:02.725768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:02.726573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.726851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.727119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.727800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:02.730018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:02.742430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:02.748663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:02.749715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 423/831] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:02.750477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:02.755918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d65ce-e45d-498e-b89c-4ec38a8928bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:02.756635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d65ce-e45d-498e-b89c-4ec38a8928bf None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.756996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d65ce-e45d-498e-b89c-4ec38a8928bf None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.757332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d65ce-e45d-498e-b89c-4ec38a8928bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.825728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d65ce-e45d-498e-b89c-4ec38a8928bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:02.827450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d65ce-e45d-498e-b89c-4ec38a8928bf None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:02.846848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750d1b1-c308-4eee-aeb6-dbbf00f22ee3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:02.882611 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8cf7-f361-48a0-acf2-01935862f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:02.883425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8cf7-f361-48a0-acf2-01935862f7aa None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:02.883704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8cf7-f361-48a0-acf2-01935862f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:02.883969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8cf7-f361-48a0-acf2-01935862f7aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:02.893890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac8cf7-f361-48a0-acf2-01935862f7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-78ac8cf7-f361-48a0-acf2-01935862f7aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:02.901560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:02.902497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 424/832] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:02.903731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8cf7-f361-48a0-acf2-01935862f7aa None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:02.927400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 409/833] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:02.932277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d65ce-e45d-498e-b89c-4ec38a8928bf None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.002145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8cf7-f361-48a0-acf2-01935862f7aa None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.028259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d65ce-e45d-498e-b89c-4ec38a8928bf None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.035879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.036537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.036814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.037085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.037784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:03.038084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.039468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.048432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 425/834] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:03.048432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.061766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.062432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.062711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.062981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.063761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:03.064066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.065712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.079041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 410/835] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:03.079725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.159975 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ebe68-2cab-45c2-9946-ae29f5c79704 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.174295 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1393c-f710-4e80-9991-b58dcb9fa4b2 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.198265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.198265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.198265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.198265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.208941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.210393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.216605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.217313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.217592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.217915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.218620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:03.218922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.220330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.235473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 411/836] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:03.235473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:03.235760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:03.236608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:03.237506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:03.237506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:03.237506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:03.237506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:03.237506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 426/837] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:03.237506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.349394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eb2e2-4397-4ca4-b631-6408329e98fd None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.359955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e6d1e-43aa-4cb1-9eba-05ca50e9ecc1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.386811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.387758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.388108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.388448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.396324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.397005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.397281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.397551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.398277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:03.398577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.400027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.401022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.402503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.413730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 427/838] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:03.422274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:03.424907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:03.427552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:03.429692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:03.429692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:03.429692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:03.429692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:03.429692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 412/839] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:03.433721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.544065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b973d-b773-4a0a-8053-b9abf3484689 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.545967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91d96c-ab8a-4d6f-ae99-144cbedc37c9 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.579656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.580535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.580818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.581086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.582286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.583105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.583559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.583974 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.584834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:03.585300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.586810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.588467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.589798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:03.604411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:03.605481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:03.606419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 428/841] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:03.607127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 413/841] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:03.610293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.610653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.709448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3f567-9d24-421c-9181-6e52130f1460 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.711264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeb383-6021-4603-ae0b-b10bf9dbe82f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.750019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.751257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.751567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.751888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.754180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.754999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.755468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.755884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.756826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:03.757294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.758871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.760692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.761996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.773245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 414/842] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:03.778696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:03.778983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:03.779932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:03.780840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 429/843] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:03.788218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:03.887672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3181-8f22-4848-be11-bdb4579e8bd0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.907919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7520b3-1a1f-4940-ac15-bbcf4917ba3d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:03.923812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.924718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.925596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.925940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.927130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:03.927540 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.929055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.939451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 415/844] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/role_assignments?user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:03.949797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:03.950807 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:03.951321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:03.951793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:03.952856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:03.953363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:03.955044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:03.976817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 430/845] 10.222.0.93 () {56 vars in 1135 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:03.983017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:04.096454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf4bcb-e9cb-42ba-8f5f-2956ddadf7f0 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:04.133945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2420e-13ab-40e9-8046-4660fd233df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:04.134606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2420e-13ab-40e9-8046-4660fd233df8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:04.134881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2420e-13ab-40e9-8046-4660fd233df8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:04.135145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2420e-13ab-40e9-8046-4660fd233df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:04.205777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2420e-13ab-40e9-8046-4660fd233df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:04.207321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2420e-13ab-40e9-8046-4660fd233df8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:04.306093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 416/846] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:04.311972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:04.419086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44117d8-6e0f-4605-9123-b12a973b7e9d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:04.454164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:04.454968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:04.455245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:04.455551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:04.469109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:04.470516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:04.488744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:04.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:04.490537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:04.490537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:04.490537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:04.490537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:04.490537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 431/847] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:04.494597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11447f-f649-48a2-93d7-12c5db2a6709 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:04.494597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11447f-f649-48a2-93d7-12c5db2a6709 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:04.494885 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11447f-f649-48a2-93d7-12c5db2a6709 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:04.496260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:04.497728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 417/848] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:04.501815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b69c5-e385-4807-8981-2048803282e7 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:04.502100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b69c5-e385-4807-8981-2048803282e7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:04.502376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b69c5-e385-4807-8981-2048803282e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:04.522581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-f85b69c5-e385-4807-8981-2048803282e7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:04.523806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f85b69c5-e385-4807-8981-2048803282e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:04.599428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 418/849] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:04.615285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b69c5-e385-4807-8981-2048803282e7 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:04.617528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030086d-e10c-4f9b-a4cc-14244f7e4f0c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:04.661835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:04.663023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:04.666408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:04.666408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:04.667147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:04.667552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:04.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:04.681289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 432/850] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:04.687338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:04.716396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b69c5-e385-4807-8981-2048803282e7 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:04.750798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff234-044b-4903-8dc8-22326bc90234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:04.751482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff234-044b-4903-8dc8-22326bc90234 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:04.751860 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff234-044b-4903-8dc8-22326bc90234 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:04.752230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff234-044b-4903-8dc8-22326bc90234 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:04.762665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff234-044b-4903-8dc8-22326bc90234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-6b6ff234-044b-4903-8dc8-22326bc90234 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:04.771123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:04.772246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:45:04.773253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:04.779861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 419/851] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:45:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:04.781246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff234-044b-4903-8dc8-22326bc90234 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:04.794404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c3a9-868c-4fb9-9286-a5f571550616 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:04.829523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:04.830646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:04.831110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:04.831692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:04.838992 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:04.840685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:04.856109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:04.857019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:04.857915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:04.857915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:04.857915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:04.857915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:04.857915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:04.857915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:04.857915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:04.857915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:04.864625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 433/852] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:04.865657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:04.885517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff234-044b-4903-8dc8-22326bc90234 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:04.919942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:04.920973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:04.921193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:04.921565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:04.922475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:04.922841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:04.924315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:04.937908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 420/853] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:04.939332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:04.969287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb0513-1f23-4501-883c-0a6ef0b8c7cb None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:05.004903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:05.005644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.005933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.006208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.006993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:05.007818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:05.009568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:05.027455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 434/854] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:05.031085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:05.046134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2b133-f1eb-44ae-983c-680b1446eb06 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:05.080714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:05.081419 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.081796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.082170 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.093417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:05.095048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:05.114174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:05.115334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:05.116328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:05.116328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:05.116328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:05.116328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:05.121714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 421/855] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:05.123073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:05.146736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd6349-1a92-4d0c-8f0f-ff290d8e6492 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:05.185428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:05.186413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.186908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.187405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.188453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=d0583c8ab3414ff6b70acf6267ef0d25) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:05.188972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:05.190888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:05.219902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 435/856] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:05 2022] GET /identity/v3/role_assignments?user.id=d0583c8ab3414ff6b70acf6267ef0d25&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:05.238864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651ac2-e3c2-4a01-bf36-fb897e4eaf88 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:05.281524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:05.282182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.282468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.282737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.283505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:05.283812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:05.285270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:05.299155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 422/857] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:05.305199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:05.426460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019376fe-c7e0-44e5-a30e-b01953fe9288 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:05.461925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebcee6-3a7b-431f-96be-295eca4483d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:05.462977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebcee6-3a7b-431f-96be-295eca4483d9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.463469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebcee6-3a7b-431f-96be-295eca4483d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.463894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebcee6-3a7b-431f-96be-295eca4483d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.471859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebcee6-3a7b-431f-96be-295eca4483d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:05.473998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebcee6-3a7b-431f-96be-295eca4483d9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-34ebcee6-3a7b-431f-96be-295eca4483d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:05.489424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:05.490571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:05.491745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:05.493934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 436/858] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:45:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:05.500015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:05.544317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790ed70-5731-4468-bafc-564eb171c98f None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.544623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790ed70-5731-4468-bafc-564eb171c98f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.544790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790ed70-5731-4468-bafc-564eb171c98f None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.546489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 437/859] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:05.551435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933389-6910-4b52-a686-7e0e3d742636 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.551725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933389-6910-4b52-a686-7e0e3d742636 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.552000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933389-6910-4b52-a686-7e0e3d742636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.569452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7e933389-6910-4b52-a686-7e0e3d742636 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:05.570762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7e933389-6910-4b52-a686-7e0e3d742636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:05.603147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657742e3-40b2-4928-ad79-fa8bc8a59ffc None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:05.637713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:05.638731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.639227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.639758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.640798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:05.641296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:05.642900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:05.647559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 438/860] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:05.661888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 423/861] 10.222.0.93 () {56 vars in 1149 bytes} [Wed May 11 18:45:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:05.663203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e933389-6910-4b52-a686-7e0e3d742636 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:05.669017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:05.775793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e933389-6910-4b52-a686-7e0e3d742636 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:05.782145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf13bd-7b65-4b81-ba78-02cdfa47f83c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:05.809632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5a3e-abd0-4647-8a4e-92a4204f7622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:05.810543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5a3e-abd0-4647-8a4e-92a4204f7622 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.810982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5a3e-abd0-4647-8a4e-92a4204f7622 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.811427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f5a3e-abd0-4647-8a4e-92a4204f7622 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.812578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f5a3e-abd0-4647-8a4e-92a4204f7622 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:05.814107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f5a3e-abd0-4647-8a4e-92a4204f7622 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:05.825167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aa06a-f4d4-415c-b1b6-4309288ce002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:05.825816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aa06a-f4d4-415c-b1b6-4309288ce002 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:05.826114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aa06a-f4d4-415c-b1b6-4309288ce002 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:05.826455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aa06a-f4d4-415c-b1b6-4309288ce002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:05.832376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 439/862] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:45:05 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:05.914024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8aa06a-f4d4-415c-b1b6-4309288ce002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:05.915538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8aa06a-f4d4-415c-b1b6-4309288ce002 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:06.024249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 424/863] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:06.030072 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5a3e-abd0-4647-8a4e-92a4204f7622 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:06.142198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f5a3e-abd0-4647-8a4e-92a4204f7622 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:06.177681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd9328-5045-431e-955b-84eb2da6e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:06.178541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9328-5045-431e-955b-84eb2da6e455 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.178817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9328-5045-431e-955b-84eb2da6e455 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.179131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9328-5045-431e-955b-84eb2da6e455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.189060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd9328-5045-431e-955b-84eb2da6e455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:06.191393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd9328-5045-431e-955b-84eb2da6e455 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-4afd9328-5045-431e-955b-84eb2da6e455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:06.217590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:06.218486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:06.219558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:06.219558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:06.219558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:06.219558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:06.219558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 440/864] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:06.227551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aa06a-f4d4-415c-b1b6-4309288ce002 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:06.332436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aa06a-f4d4-415c-b1b6-4309288ce002 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:06.353633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e45f-e72c-4e19-9697-eccdb2af5cad None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.354265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e45f-e72c-4e19-9697-eccdb2af5cad None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.354743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e45f-e72c-4e19-9697-eccdb2af5cad None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.357774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 441/865] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:06.361938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769af71-2e37-4b50-90f6-8d7a1e7c9df3 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.362492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769af71-2e37-4b50-90f6-8d7a1e7c9df3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.363009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769af71-2e37-4b50-90f6-8d7a1e7c9df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.367611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:06.368275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.368556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.368829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.369549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:06.369853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:06.371817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:06.382991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c769af71-2e37-4b50-90f6-8d7a1e7c9df3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:06.387334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 425/866] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:06.388569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c769af71-2e37-4b50-90f6-8d7a1e7c9df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:06.391362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:06.467654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 442/867] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:06.484291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769af71-2e37-4b50-90f6-8d7a1e7c9df3 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:06.494990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4e94-8064-498c-a35f-0e571d8aa13b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:06.531137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:06.531995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.532450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.532558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.540567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:06.542142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:06.557751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:06.558668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:06.560007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 426/868] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:06.565500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:06.603082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769af71-2e37-4b50-90f6-8d7a1e7c9df3 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:06.637865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:06.639054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.639608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.640081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.640929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:06.642767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:06.655335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:06.656259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:06.657078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:06.665232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 443/869] 10.222.0.93 () {56 vars in 1132 bytes} [Wed May 11 18:45:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:06.666688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:06.689014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782f9e4-6afc-4deb-9969-e280697b60d7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:06.733519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:06.734155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.734436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.734757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.735588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:06.735949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:06.738091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:06.754650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 427/870] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:06.760703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:06.786649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febbf05-297b-417d-a875-2321eb32ac00 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:06.830953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:06.831940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.832406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.832892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.833778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:06.834265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:06.836237 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:06.843154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 444/871] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:06.851982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:06.866425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ab60-c78e-45d2-852d-b792ca5e4e75 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:06.910082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd16eeb-4a7e-4a01-98fc-fd4f63150f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:06.911140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd16eeb-4a7e-4a01-98fc-fd4f63150f56 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:06.911487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd16eeb-4a7e-4a01-98fc-fd4f63150f56 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:06.911765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd16eeb-4a7e-4a01-98fc-fd4f63150f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:06.912839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd16eeb-4a7e-4a01-98fc-fd4f63150f56 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=ee6716ed4ede4bd1819991a607eef29f) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:06.913175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd16eeb-4a7e-4a01-98fc-fd4f63150f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:06.914761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd16eeb-4a7e-4a01-98fc-fd4f63150f56 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:06.927473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 428/872] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:06 2022] GET /identity/v3/role_assignments?user.id=ee6716ed4ede4bd1819991a607eef29f&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:06.971617 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843a262-78ce-4c0f-87f4-ed521ab96af6 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:07.008852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbe77-8ddc-43e2-83fb-362a4234c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:07.009913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbe77-8ddc-43e2-83fb-362a4234c98c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:07.010392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbe77-8ddc-43e2-83fb-362a4234c98c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:07.010879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbe77-8ddc-43e2-83fb-362a4234c98c None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:07.011854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fbe77-8ddc-43e2-83fb-362a4234c98c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:07.012362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fbe77-8ddc-43e2-83fb-362a4234c98c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:07.013979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fbe77-8ddc-43e2-83fb-362a4234c98c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:07.023468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 445/873] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:07.552099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8a5e-a404-4af9-bdd4-3b022535459f None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:07.552818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8a5e-a404-4af9-bdd4-3b022535459f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:07.553280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8a5e-a404-4af9-bdd4-3b022535459f None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:07.554803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 429/874] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:07.560628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599c73-7a42-4cee-a120-30abffba6e58 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:07.561107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599c73-7a42-4cee-a120-30abffba6e58 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:07.561194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599c73-7a42-4cee-a120-30abffba6e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:07.578087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f5599c73-7a42-4cee-a120-30abffba6e58 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:07.579253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f5599c73-7a42-4cee-a120-30abffba6e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:07.646660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 446/875] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:07.668692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d8a5e-a404-4af9-bdd4-3b022535459f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:07.770473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d8a5e-a404-4af9-bdd4-3b022535459f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:07.804983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:07.805707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:07.805985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:07.806253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:07.806903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:07.808328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:07.821651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:07.822642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:07.824069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 430/876] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:07.832887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5599c73-7a42-4cee-a120-30abffba6e58 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:07.934922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5599c73-7a42-4cee-a120-30abffba6e58 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:07.969715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a185c75-d031-40d5-8ac2-a975d816e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:07.970372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a185c75-d031-40d5-8ac2-a975d816e50c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:07.970651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a185c75-d031-40d5-8ac2-a975d816e50c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:07.970923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a185c75-d031-40d5-8ac2-a975d816e50c None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:07.971651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a185c75-d031-40d5-8ac2-a975d816e50c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:07.971978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a185c75-d031-40d5-8ac2-a975d816e50c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:07.973339 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a185c75-d031-40d5-8ac2-a975d816e50c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:07.978266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 447/877] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:07.984360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:08.086927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc00b3-8d14-445a-85d3-4c843c87761c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:08.123000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9f893-d23d-468e-8eba-737e158841a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:08.123689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9f893-d23d-468e-8eba-737e158841a4 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:08.123969 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9f893-d23d-468e-8eba-737e158841a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:08.124241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9f893-d23d-468e-8eba-737e158841a4 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:08.124943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9f893-d23d-468e-8eba-737e158841a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:08.125243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9f893-d23d-468e-8eba-737e158841a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:08.126599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9f893-d23d-468e-8eba-737e158841a4 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:08.132013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 431/878] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:08.209873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23ff5-59b8-405e-90a4-13e2102d7d0c None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:08.209873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23ff5-59b8-405e-90a4-13e2102d7d0c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:08.209873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23ff5-59b8-405e-90a4-13e2102d7d0c None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:08.210965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 448/879] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:08.216402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efb3e6-a58a-4e96-b351-c7bed83c2d81 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:08.216691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efb3e6-a58a-4e96-b351-c7bed83c2d81 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:08.216971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efb3e6-a58a-4e96-b351-c7bed83c2d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:08.236471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a3efb3e6-a58a-4e96-b351-c7bed83c2d81 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:08.237755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a3efb3e6-a58a-4e96-b351-c7bed83c2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:08.317245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 432/880] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:08.341314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23ff5-59b8-405e-90a4-13e2102d7d0c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:08.445161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23ff5-59b8-405e-90a4-13e2102d7d0c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:08.478106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:08.479229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:08.479732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:08.480199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:08.481123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:08.482715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:08.495148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:08.496107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:08.496923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:08.499680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 449/881] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:08.505849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efb3e6-a58a-4e96-b351-c7bed83c2d81 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:08.609631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efb3e6-a58a-4e96-b351-c7bed83c2d81 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:08.644473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:08.645133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:08.645412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:08.645683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:08.646380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:08.646683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:08.648064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:08.652992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 433/882] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:08.658452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:08.761429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f933f-4d5b-4b0a-89fd-c249aa44940b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:08.798905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:08.799975 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:08.800496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:08.800975 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:08.801879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:08.802377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:08.803958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:08.809668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 450/883] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:08.816412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:08.924535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa887095-0d34-469b-88a2-bd8d4ba21ebd None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:08.960674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616edc8b-3618-4882-9b9b-f1d332c81642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:08.961331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edc8b-3618-4882-9b9b-f1d332c81642 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:08.961605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edc8b-3618-4882-9b9b-f1d332c81642 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:08.961873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edc8b-3618-4882-9b9b-f1d332c81642 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:08.962658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616edc8b-3618-4882-9b9b-f1d332c81642 None admin] RBAC: Adding query filter params (interface=public, service_id=70482b60d46548ddb72aae977adfe4a4, region_id=RegionOne) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:08.962964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616edc8b-3618-4882-9b9b-f1d332c81642 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:08.964352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616edc8b-3618-4882-9b9b-f1d332c81642 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:08.969934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 434/884] 10.222.0.93 () {56 vars in 1251 bytes} [Wed May 11 18:45:08 2022] GET /identity/v3/endpoints?service_id=70482b60d46548ddb72aae977adfe4a4&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:08.975281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:09.077570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83275-948d-475f-a019-072fb19842c0 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:09.111908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28635c89-fbc3-4039-afd2-725335455721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:09.113517 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635c89-fbc3-4039-afd2-725335455721 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.113996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635c89-fbc3-4039-afd2-725335455721 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.114464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635c89-fbc3-4039-afd2-725335455721 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.115395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28635c89-fbc3-4039-afd2-725335455721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:09.117168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28635c89-fbc3-4039-afd2-725335455721 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:09.124013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 451/885] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:45:08 2022] GET /identity/v3/services => generated 1011 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:45:09.329035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7431c2-62b1-4ecd-b580-2bbed0752c83 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.329394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7431c2-62b1-4ecd-b580-2bbed0752c83 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.329594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7431c2-62b1-4ecd-b580-2bbed0752c83 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.331279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 435/886] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:09.336607 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b780b-692d-49f0-a3b2-74b5507ef963 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.336896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b780b-692d-49f0-a3b2-74b5507ef963 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.337172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b780b-692d-49f0-a3b2-74b5507ef963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.354912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-056b780b-692d-49f0-a3b2-74b5507ef963 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:09.356148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-056b780b-692d-49f0-a3b2-74b5507ef963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:09.411464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1a13f-146a-44a8-b3dd-999a34d4167e None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.411805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1a13f-146a-44a8-b3dd-999a34d4167e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.412133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1a13f-146a-44a8-b3dd-999a34d4167e None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.413634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 436/887] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:09.419712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e85cb-68cf-440e-bffc-aa767a846a2f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.419978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e85cb-68cf-440e-bffc-aa767a846a2f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.420244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e85cb-68cf-440e-bffc-aa767a846a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.430726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 452/888] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:09.437471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b46e85cb-68cf-440e-bffc-aa767a846a2f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:09.438653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b46e85cb-68cf-440e-bffc-aa767a846a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:09.455234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b780b-692d-49f0-a3b2-74b5507ef963 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:09.512077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 437/889] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:09.535414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e85cb-68cf-440e-bffc-aa767a846a2f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:09.559582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b780b-692d-49f0-a3b2-74b5507ef963 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:09.593847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8f145-7763-4739-be67-d299937fd3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:09.595104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8f145-7763-4739-be67-d299937fd3f5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.595606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8f145-7763-4739-be67-d299937fd3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.596072 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8f145-7763-4739-be67-d299937fd3f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.606781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8f145-7763-4739-be67-d299937fd3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-90f8f145-7763-4739-be67-d299937fd3f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:09.615207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:09.616178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:09.617024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:09.619790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 453/890] 10.222.0.93 () {56 vars in 1120 bytes} [Wed May 11 18:45:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:09.625639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8f145-7763-4739-be67-d299937fd3f5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:09.635822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e85cb-68cf-440e-bffc-aa767a846a2f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:09.670654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071bbfa-4c09-44c8-ac00-a61f3b60b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:09.671343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071bbfa-4c09-44c8-ac00-a61f3b60b0c8 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.671630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071bbfa-4c09-44c8-ac00-a61f3b60b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.671954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071bbfa-4c09-44c8-ac00-a61f3b60b0c8 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.672622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071bbfa-4c09-44c8-ac00-a61f3b60b0c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:09.673983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071bbfa-4c09-44c8-ac00-a61f3b60b0c8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:09.695471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 438/891] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:45:09 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:09.740073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8f145-7763-4739-be67-d299937fd3f5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:09.783652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:09.784717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.785195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.785734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.786734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:09.787276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:09.789110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:09.798892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 454/892] 10.222.0.93 () {56 vars in 1115 bytes} [Wed May 11 18:45:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:09.805591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071bbfa-4c09-44c8-ac00-a61f3b60b0c8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:09.913480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071bbfa-4c09-44c8-ac00-a61f3b60b0c8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:09.946686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:09.947512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:09.947789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:09.948056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:09.959921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:09.961369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:09.979359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:09.980285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:09.981143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:09.981143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:09.981143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:09.981143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:09.981143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 439/893] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:09.987239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:10.089203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3202d21-3ab2-4c3d-a030-fe3b94fed58a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:10.123364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:10.124080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:10.124363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:10.124634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:10.125352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:10.125749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:10.127123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:10.139524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 455/894] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:10.145196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:10.247899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb04d15-5d98-4dbb-a871-0b19cb261bae None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:10.282372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c752884-85a8-4516-9760-023861d60add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:10.283540 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c752884-85a8-4516-9760-023861d60add None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:10.283999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c752884-85a8-4516-9760-023861d60add None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:10.284470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c752884-85a8-4516-9760-023861d60add None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:10.293461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c752884-85a8-4516-9760-023861d60add None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:10.295188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c752884-85a8-4516-9760-023861d60add None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-8c752884-85a8-4516-9760-023861d60add None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:10.311168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:10.312192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:10.313105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:10.316443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 440/895] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:45:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:10.322470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:10.430378 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1159501-44f9-4037-99e3-b81518e8cc3b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:10.466038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff449a6a-2f94-4f6c-98e5-9025222abea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:10.466719 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff449a6a-2f94-4f6c-98e5-9025222abea8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:10.467003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff449a6a-2f94-4f6c-98e5-9025222abea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:10.467279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff449a6a-2f94-4f6c-98e5-9025222abea8 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:10.468150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff449a6a-2f94-4f6c-98e5-9025222abea8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:10.468457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff449a6a-2f94-4f6c-98e5-9025222abea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:10.469894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff449a6a-2f94-4f6c-98e5-9025222abea8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:10.488267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 456/896] 10.222.0.93 () {56 vars in 1149 bytes} [Wed May 11 18:45:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:10.493775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c752884-85a8-4516-9760-023861d60add None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:10.502218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89365-cf35-463d-bd55-a3d7170084c1 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:10.502502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89365-cf35-463d-bd55-a3d7170084c1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:10.502775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89365-cf35-463d-bd55-a3d7170084c1 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:10.504971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 457/897] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:10.510179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc23ee-8532-4021-891d-eacb66ff9253 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:10.510643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc23ee-8532-4021-891d-eacb66ff9253 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:10.511063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc23ee-8532-4021-891d-eacb66ff9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:10.527444 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-02bc23ee-8532-4021-891d-eacb66ff9253 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:10.528709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-02bc23ee-8532-4021-891d-eacb66ff9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:10.599334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 458/898] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:10.609469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c752884-85a8-4516-9760-023861d60add None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:10.621971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc23ee-8532-4021-891d-eacb66ff9253 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:10.650299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8dbf-388d-45be-aa2e-160a8f4f04da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:10.651458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8dbf-388d-45be-aa2e-160a8f4f04da None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:10.652289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8dbf-388d-45be-aa2e-160a8f4f04da None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:10.653056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8dbf-388d-45be-aa2e-160a8f4f04da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:10.720221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc23ee-8532-4021-891d-eacb66ff9253 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:10.743184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8dbf-388d-45be-aa2e-160a8f4f04da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:10.744595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8dbf-388d-45be-aa2e-160a8f4f04da None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:10.763961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92560ed4-699f-4906-b745-8ae368a8b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:10.765716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92560ed4-699f-4906-b745-8ae368a8b6d8 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:10.766197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92560ed4-699f-4906-b745-8ae368a8b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:10.766917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92560ed4-699f-4906-b745-8ae368a8b6d8 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:10.768067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92560ed4-699f-4906-b745-8ae368a8b6d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:10.770219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92560ed4-699f-4906-b745-8ae368a8b6d8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:10.787458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 459/899] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:45:10 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:10.857570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 441/900] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:10 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:10.867429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92560ed4-699f-4906-b745-8ae368a8b6d8 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:10.985049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92560ed4-699f-4906-b745-8ae368a8b6d8 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:11.019212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:11.020042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.020318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.020585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.031139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:11.032660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:11.051717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:11.052619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:11.053483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:11.053483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:11.053483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:11.053483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:11.053483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 460/901] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:11.058800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8dbf-388d-45be-aa2e-160a8f4f04da None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:11.160665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8dbf-388d-45be-aa2e-160a8f4f04da None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:11.195004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:11.196064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.196540 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.197002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.197936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:11.198431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:11.200016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:11.212896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 442/902] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:11.218226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:11.326194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4adaa5-19aa-491e-9259-fd30a02e8ca9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:11.363893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4cae1-3919-408b-b798-e3915be89991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:11.364692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4cae1-3919-408b-b798-e3915be89991 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.364969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4cae1-3919-408b-b798-e3915be89991 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.365241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4cae1-3919-408b-b798-e3915be89991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.376683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4cae1-3919-408b-b798-e3915be89991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:11.378502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4cae1-3919-408b-b798-e3915be89991 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-0ec4cae1-3919-408b-b798-e3915be89991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:11.392774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:11.394299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:11.395248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:11.395248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:11.395248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:11.395248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:11.395248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:11.395248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:11.395248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:11.395248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:11.397852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 461/903] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:11.404384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:11.509826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a6b0-6c71-4666-bfe2-c297d38d10b1 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.510503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f97e95-7f7e-4ddc-899e-68c977730b0d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:11.510626 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a6b0-6c71-4666-bfe2-c297d38d10b1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.511100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a6b0-6c71-4666-bfe2-c297d38d10b1 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.512903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 462/904] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:11.518341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979d3a-59d5-4947-b08f-dfe436e46d7e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.519462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979d3a-59d5-4947-b08f-dfe436e46d7e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.519955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979d3a-59d5-4947-b08f-dfe436e46d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.541068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-86979d3a-59d5-4947-b08f-dfe436e46d7e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:11.542696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-86979d3a-59d5-4947-b08f-dfe436e46d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:11.544204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:11.544859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.545134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.545404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.546254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:11.546554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:11.548045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:11.563346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 443/905] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:11.567444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:11.639519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 463/906] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:11.664341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979d3a-59d5-4947-b08f-dfe436e46d7e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:11.678880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884a764-548d-439d-8ba7-5f3f5c2a1da6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:11.724610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:11.726131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.726601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.727072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.728112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] RBAC: Adding query filter params (role.id=e777e59cb0244eb389b36ba001c3795c, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=ee6716ed4ede4bd1819991a607eef29f) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:11.728730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:11.731107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:11.747329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 444/907] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:11 2022] GET /identity/v3/role_assignments?user.id=ee6716ed4ede4bd1819991a607eef29f&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e777e59cb0244eb389b36ba001c3795c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:11.772198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979d3a-59d5-4947-b08f-dfe436e46d7e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:11.807766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:11.808586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.808927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.809199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.809859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:11.811348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:11.824963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:11.826081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:11.826900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 464/908] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:11.834891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:11.947146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09024140-dc3d-41c1-95ce-b5854ef76d1b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:11.982138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a398-fd82-4708-a1a7-1f1fee6a208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:11.983198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a398-fd82-4708-a1a7-1f1fee6a208e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:11.983717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a398-fd82-4708-a1a7-1f1fee6a208e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:11.984211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a398-fd82-4708-a1a7-1f1fee6a208e None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:11.985146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a398-fd82-4708-a1a7-1f1fee6a208e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:11.985674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a398-fd82-4708-a1a7-1f1fee6a208e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:11.987849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a398-fd82-4708-a1a7-1f1fee6a208e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:11.994060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 445/909] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:12.000457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:12.074670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14122bb5-731a-4f05-b981-21d1f293ad3c None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:12.075214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14122bb5-731a-4f05-b981-21d1f293ad3c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:12.075214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14122bb5-731a-4f05-b981-21d1f293ad3c None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:12.076702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 446/910] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:12.082641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9b8e8-d502-47dd-ba65-0c3a6bf8503e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:12.083224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9b8e8-d502-47dd-ba65-0c3a6bf8503e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:12.083748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9b8e8-d502-47dd-ba65-0c3a6bf8503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:12.100818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-5ea9b8e8-d502-47dd-ba65-0c3a6bf8503e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:12.102349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5ea9b8e8-d502-47dd-ba65-0c3a6bf8503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:12.112870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18752e34-22ce-4f29-87eb-39f754f41ad8 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:12.155222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:12.155920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:12.156197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:12.156472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:12.157176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:12.157481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:12.159643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:12.166318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 465/911] 10.222.0.93 () {56 vars in 1114 bytes} [Wed May 11 18:45:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:12.172224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:12.179560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 447/912] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:12.207624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9b8e8-d502-47dd-ba65-0c3a6bf8503e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:12.274668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68ba5d-9921-450f-9d29-a6ab3fe8abf8 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:12.309754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9b8e8-d502-47dd-ba65-0c3a6bf8503e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:12.311501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfca96-3024-409f-bc89-3665e8aa6756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:12.312194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfca96-3024-409f-bc89-3665e8aa6756 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:12.312433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfca96-3024-409f-bc89-3665e8aa6756 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:12.312705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfca96-3024-409f-bc89-3665e8aa6756 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:12.313433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfca96-3024-409f-bc89-3665e8aa6756 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:12.315052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfca96-3024-409f-bc89-3665e8aa6756 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:12.358015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:12.359252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:12.359880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:12.360368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:12.361412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:12.363082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:12.365131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 466/913] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:45:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:12.384444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:12.385458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:12.386301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:12.389622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 448/914] 10.222.0.93 () {56 vars in 1132 bytes} [Wed May 11 18:45:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:12.396867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfca96-3024-409f-bc89-3665e8aa6756 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:12.528461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfca96-3024-409f-bc89-3665e8aa6756 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:12.570010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:12.571127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:12.571656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:12.572218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:12.573195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:12.573747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:12.575553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:12.582174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 467/915] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:12.588756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:12.724957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f60085-451e-458e-a298-40a7ec2211cb None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:12.760393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:12.761453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:12.761999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:12.762478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:12.763433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:12.763972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:12.765545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:12.771946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 449/916] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:12.780670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:12.888789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42f44d-3b7d-4a2a-8600-d60d52ff5e02 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:12.924721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ef6ec-a4f7-46a4-aa27-c797e8412f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:12.926316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ef6ec-a4f7-46a4-aa27-c797e8412f2f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:12.926804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ef6ec-a4f7-46a4-aa27-c797e8412f2f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:12.927282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ef6ec-a4f7-46a4-aa27-c797e8412f2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:12.928354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ef6ec-a4f7-46a4-aa27-c797e8412f2f None admin] RBAC: Adding query filter params (interface=public, service_id=41765b1b8c7442deb3a6c15cdcd6f407, region_id=RegionOne) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:12.928913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ef6ec-a4f7-46a4-aa27-c797e8412f2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:12.930551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ef6ec-a4f7-46a4-aa27-c797e8412f2f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:12.937102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 468/917] 10.222.0.93 () {56 vars in 1251 bytes} [Wed May 11 18:45:12 2022] GET /identity/v3/endpoints?service_id=41765b1b8c7442deb3a6c15cdcd6f407&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:12.943671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:13.053732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f64c02-5b9f-4913-8f0c-a6909e818071 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:13.088778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7842ec-92a1-4a2f-aa7e-1b36ca4e3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:13.090231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7842ec-92a1-4a2f-aa7e-1b36ca4e3601 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:13.090717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7842ec-92a1-4a2f-aa7e-1b36ca4e3601 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:13.091218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7842ec-92a1-4a2f-aa7e-1b36ca4e3601 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:13.092140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7842ec-92a1-4a2f-aa7e-1b36ca4e3601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:13.093699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7842ec-92a1-4a2f-aa7e-1b36ca4e3601 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:13.100897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 450/918] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:45:12 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:45:13.200351 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0cf2c-85a0-4249-8fbe-dc7121d3cf9d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:13.200675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0cf2c-85a0-4249-8fbe-dc7121d3cf9d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:13.203320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0cf2c-85a0-4249-8fbe-dc7121d3cf9d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:13.203320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 469/919] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:13.208553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecadde5-4ccd-4df1-ae4d-168f2b8b798c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:13.208838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecadde5-4ccd-4df1-ae4d-168f2b8b798c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:13.209115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecadde5-4ccd-4df1-ae4d-168f2b8b798c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:13.227107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-cecadde5-4ccd-4df1-ae4d-168f2b8b798c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:13.228350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-cecadde5-4ccd-4df1-ae4d-168f2b8b798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:13.304004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 451/920] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:13.323071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0cf2c-85a0-4249-8fbe-dc7121d3cf9d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:13.426078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0cf2c-85a0-4249-8fbe-dc7121d3cf9d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:13.460656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:13.461512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:13.461793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:13.462065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:13.462711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:13.464176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:13.476696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:13.477722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:13.478549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:13.483059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 470/921] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:13.484548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecadde5-4ccd-4df1-ae4d-168f2b8b798c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:13.584152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecadde5-4ccd-4df1-ae4d-168f2b8b798c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:13.618936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:13.620013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:13.620502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:13.621018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:13.621922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:13.622429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:13.624030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:13.629862 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 452/922] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:13.636696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:13.737186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5e90-8e96-4b79-b6cd-988d51ca9f86 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:13.771484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:13.772197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:13.772479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:13.772751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:13.773452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:13.773750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:13.775116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:13.784057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 471/923] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:13.786672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:13.898873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8325c-25d8-41be-9bde-9c4760472d4c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:13.933818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bad6a2-e3a9-4026-8d80-2ef8daaf03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:13.934902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad6a2-e3a9-4026-8d80-2ef8daaf03c0 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:13.935450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad6a2-e3a9-4026-8d80-2ef8daaf03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:13.935927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad6a2-e3a9-4026-8d80-2ef8daaf03c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:13.936933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bad6a2-e3a9-4026-8d80-2ef8daaf03c0 None admin] RBAC: Adding query filter params (interface=public, service_id=947749e87a164aae912f7e771f60341e, region_id=RegionOne) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:13.937456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bad6a2-e3a9-4026-8d80-2ef8daaf03c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:13.939043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bad6a2-e3a9-4026-8d80-2ef8daaf03c0 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:13.945949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 453/924] 10.222.0.93 () {56 vars in 1251 bytes} [Wed May 11 18:45:13 2022] GET /identity/v3/endpoints?service_id=947749e87a164aae912f7e771f60341e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:13.954066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:14.049391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8d72-b641-41f1-b82f-e7f4612c0434 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.049754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8d72-b641-41f1-b82f-e7f4612c0434 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.049998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8d72-b641-41f1-b82f-e7f4612c0434 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.051957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 454/925] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:14.056152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5094cad-8f52-4226-8a2a-5cd5154d7653 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:14.056932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df885-bbf6-46d7-bc19-989e55dd1feb None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.057218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df885-bbf6-46d7-bc19-989e55dd1feb None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.057497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df885-bbf6-46d7-bc19-989e55dd1feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.074952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-140df885-bbf6-46d7-bc19-989e55dd1feb None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:14.076183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-140df885-bbf6-46d7-bc19-989e55dd1feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:14.092466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd6931-00ea-44d8-81b9-363b015ffea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:14.093437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6931-00ea-44d8-81b9-363b015ffea2 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.094017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6931-00ea-44d8-81b9-363b015ffea2 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.094489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6931-00ea-44d8-81b9-363b015ffea2 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.095394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd6931-00ea-44d8-81b9-363b015ffea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:14.097007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd6931-00ea-44d8-81b9-363b015ffea2 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:14.103727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 472/926] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:45:13 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:45:14.150612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 455/927] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:14.174249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd6931-00ea-44d8-81b9-363b015ffea2 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:14.282676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd6931-00ea-44d8-81b9-363b015ffea2 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:14.321844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd105e2-69bb-4a93-8481-0a86fce84903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:14.322658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd105e2-69bb-4a93-8481-0a86fce84903 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.322940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd105e2-69bb-4a93-8481-0a86fce84903 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.323215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd105e2-69bb-4a93-8481-0a86fce84903 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.333834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd105e2-69bb-4a93-8481-0a86fce84903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-6cd105e2-69bb-4a93-8481-0a86fce84903 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:14.342211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:14.343154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:14.344051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 473/928] 10.222.0.93 () {56 vars in 1120 bytes} [Wed May 11 18:45:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:14.349714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df885-bbf6-46d7-bc19-989e55dd1feb None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:14.453995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df885-bbf6-46d7-bc19-989e55dd1feb None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:14.489690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:14.490361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.490642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.490914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.491698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:14.492011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:14.493381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:14.502383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 456/929] 10.222.0.93 () {56 vars in 1115 bytes} [Wed May 11 18:45:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:14.509312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd105e2-69bb-4a93-8481-0a86fce84903 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:14.611131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd105e2-69bb-4a93-8481-0a86fce84903 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:14.648445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:14.649583 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.650059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.650526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.661749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:14.663510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:14.681080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:14.682001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:14.682878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:14.682878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:14.682878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:14.682878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:14.684908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 474/930] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:14.691408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:14.797792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b30f-f46f-4846-aada-848a5e4cb7ff None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:14.832904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae28697-caaa-400c-a274-88ed94030f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:14.833940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28697-caaa-400c-a274-88ed94030f14 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.834447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28697-caaa-400c-a274-88ed94030f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.834927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28697-caaa-400c-a274-88ed94030f14 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.835911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae28697-caaa-400c-a274-88ed94030f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:14.836423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae28697-caaa-400c-a274-88ed94030f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:14.838011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae28697-caaa-400c-a274-88ed94030f14 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:14.851680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 457/931] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:14.857489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:14.954293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a1abf-d267-48d5-9e45-507e64fb4d05 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.954619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a1abf-d267-48d5-9e45-507e64fb4d05 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.954896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a1abf-d267-48d5-9e45-507e64fb4d05 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.957027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 458/932] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:14.960504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67019d-b69d-43d3-bc4d-054e37e87288 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:14.962080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94828c3-b8d4-45f9-a72e-b446dd974052 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:14.962352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94828c3-b8d4-45f9-a72e-b446dd974052 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:14.962625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94828c3-b8d4-45f9-a72e-b446dd974052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:14.985275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a94828c3-b8d4-45f9-a72e-b446dd974052 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:14.986766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a94828c3-b8d4-45f9-a72e-b446dd974052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:15.006622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.008421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.008917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.009459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.020630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.023124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:15.043032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:15.044101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:15.045070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:15.048582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 475/933] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:45:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:15.055349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.066638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 459/934] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:15.089812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94828c3-b8d4-45f9-a72e-b446dd974052 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.170335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d2f87-9dee-427f-bc70-8ff9b01c26b5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.193618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94828c3-b8d4-45f9-a72e-b446dd974052 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.213290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.214209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.214693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.215165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.216260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:15.216791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.218434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.227935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.228595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.228873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.229146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.229860 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.231273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.232663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING keystone.server.flask.common [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 18:45:15.239601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 476/935] 10.222.0.93 () {56 vars in 1149 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:15.246257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.255333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.sql.core [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 18:45:15.255333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 18:45:15.255333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [parameters: {'id': 'dddfa682bcc4440e835acfb348108001', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 18:45:15.255333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79853) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dddfa682bcc4440e835acfb348108001.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dddfa682bcc4440e835acfb348108001. May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application result = self._query(query) May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application conn.query(q) May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 18:45:15.274515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application result.read() May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 11 18:45:15.275415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return project_ref.to_dict() May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application next(self.gen) May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application yield resource May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application next(self.gen) May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self.session.rollback() May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self.force_reraise() May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise self.value May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application session.commit() May 11 18:45:15.276476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._prepare_impl() May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self.session.flush() May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._flush(objects) May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application compat.raise_( May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application flush_context.execute() May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 18:45:15.277351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rec.execute(self) May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 18:45:15.278258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application result = self._query(query) May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application conn.query(q) May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application result.read() May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 18:45:15.279051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [parameters: {'id': 'dddfa682bcc4440e835acfb348108001', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.286244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:15.288151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.Conflict( May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dddfa682bcc4440e835acfb348108001. May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 460/936] 10.222.0.93 () {60 vars in 1140 bytes} [Wed May 11 18:45:15 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:15.290294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.369551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c744c6a-8193-4f1f-8589-5d9c0049ccf5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.407161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.408471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.408751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.409570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.420889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39ea1-aa9c-4167-9994-e8237e7067c9 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.422769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.425644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:15.448032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:15.449037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:15.449918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:15.449918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:15.449918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:15.449918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:15.454140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 477/937] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:15.455747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.463061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.464220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.464700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.465188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.472889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.474834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:15.490163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:15.491076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:15.491992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:15.491992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:15.491992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:15.491992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:15.491992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:15.491992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:15.491992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:15.491992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.494566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 461/938] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:15.504281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.560581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075122ac-2628-4913-b009-4b2f5e9b2701 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.595462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a7279-2550-4587-83ac-66648abcc128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.596126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7279-2550-4587-83ac-66648abcc128 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.596405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7279-2550-4587-83ac-66648abcc128 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.597202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7279-2550-4587-83ac-66648abcc128 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.597918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a7279-2550-4587-83ac-66648abcc128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:15.598220 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a7279-2550-4587-83ac-66648abcc128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.599617 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a7279-2550-4587-83ac-66648abcc128 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.604922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94557d4-52fa-4aca-ba1e-1d6d313b9db5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.610472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 478/939] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:15.616214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c8bf-2660-4281-89a5-9c1e602231a2 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.616493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c8bf-2660-4281-89a5-9c1e602231a2 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.616764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c8bf-2660-4281-89a5-9c1e602231a2 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.618042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 479/940] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:15.618724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0c8bf-2660-4281-89a5-9c1e602231a2 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.642918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24786f-5f10-4a7d-abc7-d926b85fd99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.643537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24786f-5f10-4a7d-abc7-d926b85fd99a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.643811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24786f-5f10-4a7d-abc7-d926b85fd99a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.644254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24786f-5f10-4a7d-abc7-d926b85fd99a None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.644814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24786f-5f10-4a7d-abc7-d926b85fd99a None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:15.645116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24786f-5f10-4a7d-abc7-d926b85fd99a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.646624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24786f-5f10-4a7d-abc7-d926b85fd99a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.675801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 462/941] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:15.675801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1fd28-6642-4f3c-937c-acf2ed97e86d None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.675801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1fd28-6642-4f3c-937c-acf2ed97e86d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.675801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1fd28-6642-4f3c-937c-acf2ed97e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.696838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-03d1fd28-6642-4f3c-937c-acf2ed97e86d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:15.699272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-03d1fd28-6642-4f3c-937c-acf2ed97e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:15.738553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0c8bf-2660-4281-89a5-9c1e602231a2 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.778218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.779020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.779312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.779589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.786770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.788273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.791485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 463/942] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:15.808130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:15.809150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:15.810240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 480/943] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:15.814419 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1fd28-6642-4f3c-937c-acf2ed97e86d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.819585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:15.924506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1fd28-6642-4f3c-937c-acf2ed97e86d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.939187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315b5f-9bd3-47dc-8408-65382d4cfee9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:15.966945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.968165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.968441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.968708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.969359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.970712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.980812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:15.981485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:15.981771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:15.982094 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:15.982883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:15.983193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:15.983917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:15.984797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 18:45:15.985626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:15.986387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:15.986456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 464/944] 10.222.0.93 () {56 vars in 1132 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:15.993700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:16.002081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 481/945] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:16.006034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:16.100579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2fce1-794e-4207-aa61-7b5437b6f405 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:16.121801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4a07-3656-436c-885c-19b6c4a78486 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:16.145572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:16.146653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:16.147579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:16.148064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:16.149274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:16.149935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:16.152157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:16.159229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 465/946] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:16.160699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079527e0-8538-41be-9f57-659b2d672be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:16.161597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079527e0-8538-41be-9f57-659b2d672be9 None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:16.161880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079527e0-8538-41be-9f57-659b2d672be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:16.162150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079527e0-8538-41be-9f57-659b2d672be9 None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/ee6716ed4ede4bd1819991a607eef29f/roles/e777e59cb0244eb389b36ba001c3795c` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:16.164317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:16.164427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079527e0-8538-41be-9f57-659b2d672be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=ee6716ed4ede4bd1819991a607eef29f, role_id=e777e59cb0244eb389b36ba001c3795c)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:16.165973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079527e0-8538-41be-9f57-659b2d672be9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:16.187405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 482/947] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:45:16 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/ee6716ed4ede4bd1819991a607eef29f/roles/e777e59cb0244eb389b36ba001c3795c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:45:16.295027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0349e0-965b-4abc-906b-dab19843f2d8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:16.337029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5724a-d3d2-4d45-860c-2b69105efc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:16.337703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5724a-d3d2-4d45-860c-2b69105efc89 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:16.337978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5724a-d3d2-4d45-860c-2b69105efc89 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:16.338245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5724a-d3d2-4d45-860c-2b69105efc89 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:16.338956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5724a-d3d2-4d45-860c-2b69105efc89 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:16.339256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5724a-d3d2-4d45-860c-2b69105efc89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:16.340649 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5724a-d3d2-4d45-860c-2b69105efc89 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:16.347677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 466/948] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:16.353067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079527e0-8538-41be-9f57-659b2d672be9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:16.471122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079527e0-8538-41be-9f57-659b2d672be9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:16.497168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e3693-5ebb-4251-be29-38f7773e0d1c None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:16.497490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e3693-5ebb-4251-be29-38f7773e0d1c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:16.497726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e3693-5ebb-4251-be29-38f7773e0d1c None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:16.499373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 467/949] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:16.504809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8bfb-a035-4597-900d-32c8fcc7c095 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:16.505096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8bfb-a035-4597-900d-32c8fcc7c095 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:16.505438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8bfb-a035-4597-900d-32c8fcc7c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:16.506930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd689e7a-c5d0-4416-a814-54ba821c9d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:16.507674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd689e7a-c5d0-4416-a814-54ba821c9d57 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:16.507958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd689e7a-c5d0-4416-a814-54ba821c9d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:16.508233 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd689e7a-c5d0-4416-a814-54ba821c9d57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:16.508983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd689e7a-c5d0-4416-a814-54ba821c9d57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:16.510352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd689e7a-c5d0-4416-a814-54ba821c9d57 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:16.523035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ce5e8bfb-a035-4597-900d-32c8fcc7c095 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:16.524569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ce5e8bfb-a035-4597-900d-32c8fcc7c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:16.530639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 483/950] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:45:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:45:16.613630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 468/951] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:16.640043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd689e7a-c5d0-4416-a814-54ba821c9d57 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:16.758003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd689e7a-c5d0-4416-a814-54ba821c9d57 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:16.795559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:16.796368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:16.796650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:16.796920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:16.797571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:16.798943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:16.811038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:16.812054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:16.812896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 484/952] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:16.821151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e8bfb-a035-4597-900d-32c8fcc7c095 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:16.919407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e8bfb-a035-4597-900d-32c8fcc7c095 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:16.954327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:16.955396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:16.955949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:16.956426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:16.957349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:16.957876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:16.959465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:16.964897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 469/953] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:16.970760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:17.079604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1e15f-1087-4eee-94fa-801d897ce01e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:17.114126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a611c-2774-4349-a4f4-5d527ec8c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:17.114797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a611c-2774-4349-a4f4-5d527ec8c946 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:17.115075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a611c-2774-4349-a4f4-5d527ec8c946 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:17.115392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a611c-2774-4349-a4f4-5d527ec8c946 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:17.116100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a611c-2774-4349-a4f4-5d527ec8c946 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:17.116402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a611c-2774-4349-a4f4-5d527ec8c946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:17.117776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a611c-2774-4349-a4f4-5d527ec8c946 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:17.123039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 485/954] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:17.129331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:17.247043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d359ad-26ff-4bfa-b511-ce411511c170 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:17.280895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5522c-af66-4090-9cf1-394020bd95c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:17.281604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5522c-af66-4090-9cf1-394020bd95c9 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:17.281887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5522c-af66-4090-9cf1-394020bd95c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:17.282158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5522c-af66-4090-9cf1-394020bd95c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:17.282903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5522c-af66-4090-9cf1-394020bd95c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:17.284361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5522c-af66-4090-9cf1-394020bd95c9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:17.303925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 470/955] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:45:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:45:18.116639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55c88-3a95-48ba-8f7d-dd83621c61a0 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.117166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55c88-3a95-48ba-8f7d-dd83621c61a0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.117166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55c88-3a95-48ba-8f7d-dd83621c61a0 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.118786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 486/956] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:18.124365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99a6d0-faa3-4b4e-a11b-e4bee31a1ffc None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.124895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99a6d0-faa3-4b4e-a11b-e4bee31a1ffc None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.125371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99a6d0-faa3-4b4e-a11b-e4bee31a1ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.143018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-5c99a6d0-faa3-4b4e-a11b-e4bee31a1ffc None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:18.145092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5c99a6d0-faa3-4b4e-a11b-e4bee31a1ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:18.237665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 471/957] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:18.261664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55c88-3a95-48ba-8f7d-dd83621c61a0 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:18.366222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55c88-3a95-48ba-8f7d-dd83621c61a0 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:18.401847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:18.402431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.402710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.402978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.403699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:18.405185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:18.406493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING keystone.server.flask.common [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 18:45:18.420316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.sql.core [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 18:45:18.420316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 18:45:18.420316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [parameters: {'user_id': '686ef964f9374912954f9776f8e7d524', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 18:45:18.420316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79852) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-65353bcd-5da8-48f7-9f5e-42d8d0307d2b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result = self._query(query) May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application conn.query(q) May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result.read() May 11 18:45:18.428624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 18:45:18.429470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application next(self.gen) May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application yield resource May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application next(self.gen) May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.session.rollback() May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.force_reraise() May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise self.value May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application session.commit() May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 18:45:18.430390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._prepare_impl() May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.session.flush() May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._flush(objects) May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application compat.raise_( May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application flush_context.execute() May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rec.execute(self) May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 18:45:18.431765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result = connection._execute_20( May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 18:45:18.432627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result = self._query(query) May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application conn.query(q) May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application result.read() May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 18:45:18.433448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [parameters: {'user_id': '686ef964f9374912954f9776f8e7d524', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:18.434286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 11 18:45:18.436777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 11 18:45:18.440713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 11 18:45:18.440713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 11 18:45:18.440713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 18:45:18.440713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 18:45:18.440713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 18:45:18.440713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:18.440713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 487/958] 10.222.0.93 () {60 vars in 1131 bytes} [Wed May 11 18:45:18 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:18.442827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99a6d0-faa3-4b4e-a11b-e4bee31a1ffc None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:18.545735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99a6d0-faa3-4b4e-a11b-e4bee31a1ffc None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:18.555892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192f4f-358b-4649-8196-eb58919870a1 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.556191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192f4f-358b-4649-8196-eb58919870a1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.556438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192f4f-358b-4649-8196-eb58919870a1 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.563394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 488/959] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:18.566774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cc4b-468a-459c-8ffe-6d4ac8b156ef None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.567062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cc4b-468a-459c-8ffe-6d4ac8b156ef None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.567356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cc4b-468a-459c-8ffe-6d4ac8b156ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.584544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b3f2cc4b-468a-459c-8ffe-6d4ac8b156ef None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:18.584936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:18.585986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.586093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b3f2cc4b-468a-459c-8ffe-6d4ac8b156ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:18.586572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.587052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.597465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:18.599799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:18.618825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:18.619845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 18:45:18.620773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:18.623950 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 472/960] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:45:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:18.632446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:18.670152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 489/961] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:18.694200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2cc4b-468a-459c-8ffe-6d4ac8b156ef None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:18.748229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13450f49-c5bd-4557-ac58-67aea2c57186 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:18.785879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:18.786574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.786853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.787126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.788061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:18.788319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:18.789809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:18.799800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2cc4b-468a-459c-8ffe-6d4ac8b156ef None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:18.831332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 473/962] 10.222.0.93 () {56 vars in 1101 bytes} [Wed May 11 18:45:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:18.840880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2740709-55db-4ea3-9ebe-e926754f6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:18.841777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2740709-55db-4ea3-9ebe-e926754f6f65 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.842058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2740709-55db-4ea3-9ebe-e926754f6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.842331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2740709-55db-4ea3-9ebe-e926754f6f65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.855350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2740709-55db-4ea3-9ebe-e926754f6f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-c2740709-55db-4ea3-9ebe-e926754f6f65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:18.864104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:18.865101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:18.866604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 490/963] 10.222.0.93 () {56 vars in 1120 bytes} [Wed May 11 18:45:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:18.871624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:18.967157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8136d8e-9264-4e03-b254-d8f737fde60b None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.967364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8136d8e-9264-4e03-b254-d8f737fde60b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.967641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8136d8e-9264-4e03-b254-d8f737fde60b None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.969195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 491/964] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:18.974936 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf8d6-da04-4a52-bf47-819feed34523 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:18.975571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf8d6-da04-4a52-bf47-819feed34523 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:18.976040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf8d6-da04-4a52-bf47-819feed34523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:18.989388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aee870-8065-459d-8031-b2c5b40de3f6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:18.997726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-bc7bf8d6-da04-4a52-bf47-819feed34523 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:18.999417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-bc7bf8d6-da04-4a52-bf47-819feed34523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:19.032596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.033268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.033546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.033817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.035985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:19.035985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.037524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.046935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 474/965] 10.222.0.93 () {56 vars in 1115 bytes} [Wed May 11 18:45:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:19.055199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.095331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 492/966] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:19.111713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf8d6-da04-4a52-bf47-819feed34523 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.181573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac212ae-0124-4d9f-b603-8c300a150867 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.221213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf8d6-da04-4a52-bf47-819feed34523 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.224458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.224686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.224948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.225216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.235563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.236989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:19.255052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:19.256000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:19.257495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:19.257495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:19.257495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:19.257495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:19.257776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.257776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.257943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 475/967] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:19.259555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.259900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.260597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.262164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.263372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:19.274206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:19.275413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:19.276867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 493/968] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:19.281120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.364483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b3a3d-8690-4d6b-a6f8-0a0d20729ef3 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.381954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d217a0-75af-400f-a8b5-fe75ebef26fc None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.396960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.397626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.397900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.398164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.398882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:19.399182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.400600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.417406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 476/969] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:19.423582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.427229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.427963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.428246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.428517 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.429241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:19.429544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.431020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.436663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 494/970] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:19.442364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.533067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73226469-1057-44b7-86d4-509fa9f3b4c6 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.541860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6320-5e72-4ca2-a7a5-e968889b70f1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.570619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.571464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.571744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.572014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.575160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ceec83-f057-4908-98d9-4305c5fefe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.575866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceec83-f057-4908-98d9-4305c5fefe41 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.576144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceec83-f057-4908-98d9-4305c5fefe41 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.576415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceec83-f057-4908-98d9-4305c5fefe41 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.577116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ceec83-f057-4908-98d9-4305c5fefe41 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:19.577415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ceec83-f057-4908-98d9-4305c5fefe41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.578804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ceec83-f057-4908-98d9-4305c5fefe41 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.579155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.580613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.584245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 495/971] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:19.597248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:19.598282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 18:45:19.604426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:19.604982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f758255-c14e-46f8-b70f-51fe040df4ce None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.604982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f758255-c14e-46f8-b70f-51fe040df4ce None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.605111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 477/972] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:19.605268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f758255-c14e-46f8-b70f-51fe040df4ce None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.605268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 496/973] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:19.605401 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.606275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4a5e-1a2c-4848-a141-8ce937770404 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.606570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4a5e-1a2c-4848-a141-8ce937770404 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.606849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d4a5e-1a2c-4848-a141-8ce937770404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.624129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-681d4a5e-1a2c-4848-a141-8ce937770404 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:19.625375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-681d4a5e-1a2c-4848-a141-8ce937770404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:19.699012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 497/974] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:19.715119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0fa71-0123-4fe0-a8f6-32217774ae66 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.721637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d4a5e-1a2c-4848-a141-8ce937770404 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.754643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.755350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.755641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.755911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.756759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:19.757064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.758494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.778357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 478/975] 10.222.0.93 () {56 vars in 1149 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:19.785183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.837515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d4a5e-1a2c-4848-a141-8ce937770404 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.870688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.871521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.871804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.872075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.872751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.874128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.881786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7351285-2bc4-4e8c-b5ae-9bcf7630c510 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:19.886679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:19.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:19.888782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:19.893041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 498/976] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:19.893803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:19.916156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba01f62-1285-40a3-a874-e77a9dfef07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:19.916796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01f62-1285-40a3-a874-e77a9dfef07d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:19.917074 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01f62-1285-40a3-a874-e77a9dfef07d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:19.917336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01f62-1285-40a3-a874-e77a9dfef07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:19.983855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba01f62-1285-40a3-a874-e77a9dfef07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:19.985300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba01f62-1285-40a3-a874-e77a9dfef07d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:19.991154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43655d5-1fff-4e8d-95dd-cac6bcfedf21 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.025755 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.026408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.026683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.026958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.027676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:20.027974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.029322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.038343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 499/977] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:20.039276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:20.091224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 479/978] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 18:45:20.094147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba01f62-1285-40a3-a874-e77a9dfef07d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:20.139367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ddef1-4d74-4aaa-b8f9-43e963bbc96e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.172785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.173442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.173717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.173990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.174765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:20.175065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.176482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.181462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 500/979] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:20.186974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:20.188105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba01f62-1285-40a3-a874-e77a9dfef07d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.227254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.228076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.228353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.228622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.238797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.240243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:20.258046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:20.258971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:20.259912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:20.259912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:20.259912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:20.259912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:20.263685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 480/980] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:20.264745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:20.285053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39a8e9-5b27-412c-8073-8414ca218882 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.320727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.321337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.321621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.321898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.322690 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] RBAC: Adding query filter params (interface=admin, service_id=947749e87a164aae912f7e771f60341e, region_id=RegionOne) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:20.323001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.324411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.329859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 501/981] 10.222.0.93 () {56 vars in 1249 bytes} [Wed May 11 18:45:20 2022] GET /identity/v3/endpoints?service_id=947749e87a164aae912f7e771f60341e&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:20.335061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:20.361831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73a847-5ea7-4684-9e51-791ab2878ed8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.396707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.397363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.397637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.397916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.398611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:20.398911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.400414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.411686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 481/982] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:20.417113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:20.435276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233781e2-a21d-4dc5-b10c-2c23ef02868a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.468802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69946e-f536-4a25-ba26-0875858cecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.469471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69946e-f536-4a25-ba26-0875858cecf5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.469759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69946e-f536-4a25-ba26-0875858cecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.470033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69946e-f536-4a25-ba26-0875858cecf5 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.470703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69946e-f536-4a25-ba26-0875858cecf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.472131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69946e-f536-4a25-ba26-0875858cecf5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.478126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 502/983] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:45:20 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:45:20.516657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957c951-48d0-4cbf-ab92-f5149590fb24 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.552169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.553005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.553267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.553533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.560970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.562433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:20.578292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:20.579185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:20.580523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:20.580523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:20.580523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:20.580523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:20.580523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:20.580523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:20.580523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:20.580523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:20.583649 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 482/984] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:20.585835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69946e-f536-4a25-ba26-0875858cecf5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:20.687582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69946e-f536-4a25-ba26-0875858cecf5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.725926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124d0b-27e6-401f-b927-5245cbe20ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.726599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124d0b-27e6-401f-b927-5245cbe20ca1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.726882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124d0b-27e6-401f-b927-5245cbe20ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.727153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124d0b-27e6-401f-b927-5245cbe20ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.727979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124d0b-27e6-401f-b927-5245cbe20ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:20.728286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124d0b-27e6-401f-b927-5245cbe20ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.729726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124d0b-27e6-401f-b927-5245cbe20ca1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.746287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 503/985] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:20.747640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:20.856793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88e267-2115-421b-ad74-5eac48a51a6d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:20.889340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee201aa-be59-4050-a431-991192a2cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:20.889998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee201aa-be59-4050-a431-991192a2cb5a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:20.890280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee201aa-be59-4050-a431-991192a2cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:20.890552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee201aa-be59-4050-a431-991192a2cb5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:20.891406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee201aa-be59-4050-a431-991192a2cb5a None admin] RBAC: Adding query filter params (role.id=e777e59cb0244eb389b36ba001c3795c, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=ee6716ed4ede4bd1819991a607eef29f) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:20.891717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee201aa-be59-4050-a431-991192a2cb5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:20.893131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee201aa-be59-4050-a431-991192a2cb5a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:20.907322 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 483/986] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:20 2022] GET /identity/v3/role_assignments?user.id=ee6716ed4ede4bd1819991a607eef29f&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e777e59cb0244eb389b36ba001c3795c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:21.826564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede8687-3928-4c00-a0b8-8f461ed64714 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:21.827127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede8687-3928-4c00-a0b8-8f461ed64714 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:21.827127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede8687-3928-4c00-a0b8-8f461ed64714 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:21.828532 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 504/987] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:21.834184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4c144-02f7-4613-922c-37c282a06284 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:21.834586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4c144-02f7-4613-922c-37c282a06284 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:21.834750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4c144-02f7-4613-922c-37c282a06284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:21.855529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-f7e4c144-02f7-4613-922c-37c282a06284 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:21.856713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f7e4c144-02f7-4613-922c-37c282a06284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:21.920122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 484/988] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:21.942681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede8687-3928-4c00-a0b8-8f461ed64714 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:22.040779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede8687-3928-4c00-a0b8-8f461ed64714 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:22.076110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f03c1-da2b-48e5-9157-2f8f9bf1073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:22.076829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f03c1-da2b-48e5-9157-2f8f9bf1073b None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:22.077058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f03c1-da2b-48e5-9157-2f8f9bf1073b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:22.077335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f03c1-da2b-48e5-9157-2f8f9bf1073b None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:22.078067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f03c1-da2b-48e5-9157-2f8f9bf1073b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:22.079467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f03c1-da2b-48e5-9157-2f8f9bf1073b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:22.094248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 505/989] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:45:21 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:22.726674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfdd32-89f5-4be9-8dd1-cb67850c4d44 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:22.727060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfdd32-89f5-4be9-8dd1-cb67850c4d44 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:22.727373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfdd32-89f5-4be9-8dd1-cb67850c4d44 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:22.728976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 485/990] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:22.734227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72427-c69f-4bf7-ac15-9608ec24aece None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:22.734521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72427-c69f-4bf7-ac15-9608ec24aece None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:22.734800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72427-c69f-4bf7-ac15-9608ec24aece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:22.751108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-44a72427-c69f-4bf7-ac15-9608ec24aece None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:22.752315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-44a72427-c69f-4bf7-ac15-9608ec24aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:22.823156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 506/991] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:22.846134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfdd32-89f5-4be9-8dd1-cb67850c4d44 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:22.948570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfdd32-89f5-4be9-8dd1-cb67850c4d44 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:22.982489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:22.983237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:22.983546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:22.983822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:22.984490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:22.985891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:22.998890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:23.000203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 18:45:23.001022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:23.002359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 486/992] 10.222.0.93 () {56 vars in 1126 bytes} [Wed May 11 18:45:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:23.006971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a72427-c69f-4bf7-ac15-9608ec24aece None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:23.100537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a72427-c69f-4bf7-ac15-9608ec24aece None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:23.133234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de71013-8d8b-4481-b080-9e3b57892dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:23.133887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de71013-8d8b-4481-b080-9e3b57892dff None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:23.134164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de71013-8d8b-4481-b080-9e3b57892dff None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:23.134432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de71013-8d8b-4481-b080-9e3b57892dff None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:23.135120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de71013-8d8b-4481-b080-9e3b57892dff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:23.135447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de71013-8d8b-4481-b080-9e3b57892dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:23.136799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de71013-8d8b-4481-b080-9e3b57892dff None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:23.141588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 507/993] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:23.147109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:23.165904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc2bd-eec8-4d92-b5a3-d56e667fdac1 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:23.166182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc2bd-eec8-4d92-b5a3-d56e667fdac1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:23.166451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc2bd-eec8-4d92-b5a3-d56e667fdac1 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:23.167862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 508/994] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:23.173165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0ef23-bf44-4dd8-ac18-2b77867b9ebf None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:23.173304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0ef23-bf44-4dd8-ac18-2b77867b9ebf None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:23.173471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0ef23-bf44-4dd8-ac18-2b77867b9ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:23.192145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-bee0ef23-bf44-4dd8-ac18-2b77867b9ebf None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:23.193318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-bee0ef23-bf44-4dd8-ac18-2b77867b9ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:23.255807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000fee2-adb2-4a09-95a5-7b149bff73f5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:23.265594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 509/995] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:23.287897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0ef23-bf44-4dd8-ac18-2b77867b9ebf None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:23.292903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:23.293568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:23.293845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:23.294114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:23.294816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:23.295116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:23.296503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:23.302312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 487/996] 10.222.0.93 () {56 vars in 1122 bytes} [Wed May 11 18:45:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:23.307907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:23.392389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0ef23-bf44-4dd8-ac18-2b77867b9ebf None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:23.407032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fe3e-9931-48f4-9866-1fee99785727 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:23.426263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:23.427059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:23.427366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:23.427646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] PATH_INFO: `/v3/services/image` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:23.428327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:23.429704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:23.441564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:23.442518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:23.448571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 510/997] 10.222.0.93 () {56 vars in 1105 bytes} [Wed May 11 18:45:23 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:23.449433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:23.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d173c-6381-4678-89d1-27c7ee78f794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:23.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d173c-6381-4678-89d1-27c7ee78f794 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:23.449503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d173c-6381-4678-89d1-27c7ee78f794 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:23.449695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d173c-6381-4678-89d1-27c7ee78f794 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:23.450401 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d173c-6381-4678-89d1-27c7ee78f794 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:23.451811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d173c-6381-4678-89d1-27c7ee78f794 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:23.475449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 488/998] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:45:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:23.552320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d38b8-e007-4abe-8718-28b013aaacc5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:23.594136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c198f-5f4d-4fc6-a993-732c182476f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:23.594820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c198f-5f4d-4fc6-a993-732c182476f0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:23.595102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c198f-5f4d-4fc6-a993-732c182476f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:23.595406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c198f-5f4d-4fc6-a993-732c182476f0 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:23.596128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c198f-5f4d-4fc6-a993-732c182476f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:23.596467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c198f-5f4d-4fc6-a993-732c182476f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:23.597873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c198f-5f4d-4fc6-a993-732c182476f0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:23.603056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 511/999] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:23.608986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d173c-6381-4678-89d1-27c7ee78f794 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:23.710245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d173c-6381-4678-89d1-27c7ee78f794 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:23.742921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2db52-b177-4bb6-9353-5ae628553e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:23.743605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2db52-b177-4bb6-9353-5ae628553e8b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:23.743881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2db52-b177-4bb6-9353-5ae628553e8b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:23.744148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2db52-b177-4bb6-9353-5ae628553e8b None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:23.744848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2db52-b177-4bb6-9353-5ae628553e8b None admin] RBAC: Adding query filter params (type=image) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:23.745142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2db52-b177-4bb6-9353-5ae628553e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:23.746494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2db52-b177-4bb6-9353-5ae628553e8b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:23.751146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 489/1000] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:24.333263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b763b-f178-4bbc-bd6b-b977e5d97ec5 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:24.333800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b763b-f178-4bbc-bd6b-b977e5d97ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:24.333800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b763b-f178-4bbc-bd6b-b977e5d97ec5 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:24.335211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 512/1001] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:24.340468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65399-9ba6-417a-84b6-b98bd12cc720 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:24.340859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65399-9ba6-417a-84b6-b98bd12cc720 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:24.341018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65399-9ba6-417a-84b6-b98bd12cc720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:24.358653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c1d65399-9ba6-417a-84b6-b98bd12cc720 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:24.359855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c1d65399-9ba6-417a-84b6-b98bd12cc720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:24.422986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 490/1002] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:24.445684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b763b-f178-4bbc-bd6b-b977e5d97ec5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:24.541796 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b763b-f178-4bbc-bd6b-b977e5d97ec5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:24.574252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:24.575052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:24.575348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:24.575620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] PATH_INFO: `/v3/services/compute` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:24.576263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:24.577635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:24.590069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:24.591055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:24.592254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:24.595615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 513/1003] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:24.597293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d65399-9ba6-417a-84b6-b98bd12cc720 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:24.701505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d65399-9ba6-417a-84b6-b98bd12cc720 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:24.733996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:24.734662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:24.734941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:24.735201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:24.735937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] RBAC: Adding query filter params (name=compute) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:24.736239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:24.738130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:24.747551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 491/1004] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:24.749834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:24.846182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3515-0ad0-4415-bc2e-0704d815d65b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:24.880462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:24.881134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:24.881411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:24.881680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:24.882379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] RBAC: Adding query filter params (type=compute) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:24.882680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:24.884070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:24.895442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 514/1005] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:24.895582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:24.999881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689bb2d-9e83-49a0-a756-cb6373423ace None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:25.032125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd5087-7f72-45ac-97c7-5c22c3d16e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:25.032782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5087-7f72-45ac-97c7-5c22c3d16e83 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:25.033069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5087-7f72-45ac-97c7-5c22c3d16e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:25.033340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5087-7f72-45ac-97c7-5c22c3d16e83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:25.034686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd5087-7f72-45ac-97c7-5c22c3d16e83 None admin] RBAC: Adding query filter params (interface=public, service_id=d879c675be9241ce91ab529de06a641a, region_id=RegionOne) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:25.034996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd5087-7f72-45ac-97c7-5c22c3d16e83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:25.036391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd5087-7f72-45ac-97c7-5c22c3d16e83 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:25.041297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 492/1006] 10.222.0.93 () {56 vars in 1251 bytes} [Wed May 11 18:45:24 2022] GET /identity/v3/endpoints?service_id=d879c675be9241ce91ab529de06a641a&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:25.046915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:25.142694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a4ba-6f28-470a-b7dd-4afdb32fcebf None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:25.174418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24afce-726e-4ef1-9778-34c75461e05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:25.175076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24afce-726e-4ef1-9778-34c75461e05a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:25.175386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24afce-726e-4ef1-9778-34c75461e05a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:25.175660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24afce-726e-4ef1-9778-34c75461e05a None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:25.176333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24afce-726e-4ef1-9778-34c75461e05a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:25.177686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24afce-726e-4ef1-9778-34c75461e05a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:25.183921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 515/1007] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:45:25 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:45:25.760421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270410e2-cf94-4fb6-a469-5c1d58231d3a None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:25.760941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270410e2-cf94-4fb6-a469-5c1d58231d3a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:25.761018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270410e2-cf94-4fb6-a469-5c1d58231d3a None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:25.762480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 493/1008] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:25.767501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0487-18b5-48a6-9cf6-6cf374616234 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:25.767892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0487-18b5-48a6-9cf6-6cf374616234 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:25.768073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0487-18b5-48a6-9cf6-6cf374616234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:25.785897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-386b0487-18b5-48a6-9cf6-6cf374616234 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:25.787131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-386b0487-18b5-48a6-9cf6-6cf374616234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:25.856256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 516/1009] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:25.878983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270410e2-cf94-4fb6-a469-5c1d58231d3a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:25.977924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270410e2-cf94-4fb6-a469-5c1d58231d3a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:25.981582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f1bca-3225-45a0-a5d9-06d301445d70 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:25.981874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f1bca-3225-45a0-a5d9-06d301445d70 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:25.982151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f1bca-3225-45a0-a5d9-06d301445d70 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:25.983544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 517/1010] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:25.988674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd6162-7877-4992-b9ee-3b76eb8c54ce None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:25.989125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd6162-7877-4992-b9ee-3b76eb8c54ce None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:25.989566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd6162-7877-4992-b9ee-3b76eb8c54ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:26.006707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-6ebd6162-7877-4992-b9ee-3b76eb8c54ce None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:26.008245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6ebd6162-7877-4992-b9ee-3b76eb8c54ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:26.012140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d37d-c82e-4cfe-a88a-9512e55cf5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:26.012866 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d37d-c82e-4cfe-a88a-9512e55cf5e7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:26.013141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d37d-c82e-4cfe-a88a-9512e55cf5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:26.013407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d37d-c82e-4cfe-a88a-9512e55cf5e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:26.014581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656d37d-c82e-4cfe-a88a-9512e55cf5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:26.016023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656d37d-c82e-4cfe-a88a-9512e55cf5e7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:26.017943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 494/1011] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:26.023830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d37d-c82e-4cfe-a88a-9512e55cf5e7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:26.076812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 518/1012] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:26.099109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd6162-7877-4992-b9ee-3b76eb8c54ce None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:26.120304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d37d-c82e-4cfe-a88a-9512e55cf5e7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:26.153003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f34c-28b4-4daa-a40b-7faa05f36dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:26.153650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f34c-28b4-4daa-a40b-7faa05f36dc3 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:26.153933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f34c-28b4-4daa-a40b-7faa05f36dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:26.154202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f34c-28b4-4daa-a40b-7faa05f36dc3 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:26.154899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f34c-28b4-4daa-a40b-7faa05f36dc3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:26.156414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f34c-28b4-4daa-a40b-7faa05f36dc3 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:26.182067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 495/1013] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:45:26 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:26.198714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd6162-7877-4992-b9ee-3b76eb8c54ce None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:26.236010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c033873-b3b2-42cc-a400-dba5447d35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:26.236688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033873-b3b2-42cc-a400-dba5447d35c6 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:26.237509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033873-b3b2-42cc-a400-dba5447d35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:26.237781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033873-b3b2-42cc-a400-dba5447d35c6 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:26.238516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c033873-b3b2-42cc-a400-dba5447d35c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:26.239962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c033873-b3b2-42cc-a400-dba5447d35c6 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:26.255280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 519/1014] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:45:26 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:27.434775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749513f6-34b2-48b2-b78e-0f6119ffed82 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:27.435511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749513f6-34b2-48b2-b78e-0f6119ffed82 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:27.435511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749513f6-34b2-48b2-b78e-0f6119ffed82 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:27.436865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 496/1015] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:27.442321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d139c5-fff1-452f-bbb7-da1bef9367af None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:27.442710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d139c5-fff1-452f-bbb7-da1bef9367af None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:27.442887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d139c5-fff1-452f-bbb7-da1bef9367af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:27.459860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b3d139c5-fff1-452f-bbb7-da1bef9367af None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:27.460975 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b3d139c5-fff1-452f-bbb7-da1bef9367af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:27.534710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 520/1016] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:27 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:27.557435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749513f6-34b2-48b2-b78e-0f6119ffed82 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:27.656871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749513f6-34b2-48b2-b78e-0f6119ffed82 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:27.689091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:27.690671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:27.690962 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:27.691233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:27.691921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:27.693283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:27.704845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:27.705837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 18:45:27.706678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:27.711135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 497/1017] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:27.712450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d139c5-fff1-452f-bbb7-da1bef9367af None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:27.806117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d139c5-fff1-452f-bbb7-da1bef9367af None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:27.838541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:27.839202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:27.839519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:27.839795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:27.840491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:27.840794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:27.842185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:27.851494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 521/1018] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:27.853081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:27.951743 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b4af-005c-43e0-97a8-0343afc1fff8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:27.984011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf73a2-b380-4cef-be1a-31207109066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:27.984600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf73a2-b380-4cef-be1a-31207109066e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:27.984881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf73a2-b380-4cef-be1a-31207109066e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:27.985156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf73a2-b380-4cef-be1a-31207109066e None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:27.985873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf73a2-b380-4cef-be1a-31207109066e None admin] RBAC: Adding query filter params (type=compute) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:27.986180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf73a2-b380-4cef-be1a-31207109066e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:27.988084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf73a2-b380-4cef-be1a-31207109066e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:27.997686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 498/1019] 10.222.0.93 () {56 vars in 1112 bytes} [Wed May 11 18:45:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:27.999146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:28.101094 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7037a7f-41ab-405a-95bb-58ec423a9755 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:28.139171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381ccbd-9175-4c52-82a6-d82ce40fbcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:28.139867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ccbd-9175-4c52-82a6-d82ce40fbcae None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.140154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ccbd-9175-4c52-82a6-d82ce40fbcae None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.140433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ccbd-9175-4c52-82a6-d82ce40fbcae None admin] PATH_INFO: `/v3/endpoints` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.141177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381ccbd-9175-4c52-82a6-d82ce40fbcae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:28.142683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381ccbd-9175-4c52-82a6-d82ce40fbcae None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:28.167041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 522/1020] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:45:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:28.455980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470204da-86b2-458a-9b4e-963d1d7a1789 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.456500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470204da-86b2-458a-9b4e-963d1d7a1789 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.456577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470204da-86b2-458a-9b4e-963d1d7a1789 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.458142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 499/1021] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:28.463556 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65def-214a-400b-a9ab-f90275ec286e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.463999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65def-214a-400b-a9ab-f90275ec286e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.464313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b65def-214a-400b-a9ab-f90275ec286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.481520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a6b65def-214a-400b-a9ab-f90275ec286e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:28.482716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a6b65def-214a-400b-a9ab-f90275ec286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:28.534739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b4a6-65a3-48a2-bb69-5b1f710b8775 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.535026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b4a6-65a3-48a2-bb69-5b1f710b8775 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.535323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010b4a6-65a3-48a2-bb69-5b1f710b8775 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.536816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 500/1022] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:28.541609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17b99b-f442-41fd-89c8-95e51c956d4f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.541902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17b99b-f442-41fd-89c8-95e51c956d4f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.542180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17b99b-f442-41fd-89c8-95e51c956d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.559347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 523/1023] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:28.559524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7c17b99b-f442-41fd-89c8-95e51c956d4f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:28.560024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7c17b99b-f442-41fd-89c8-95e51c956d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:28.580086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b65def-214a-400b-a9ab-f90275ec286e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:28.626702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 501/1024] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:28.649260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17b99b-f442-41fd-89c8-95e51c956d4f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:28.677400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b65def-214a-400b-a9ab-f90275ec286e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:28.713817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede42e1-b423-4922-9dbe-8849e90ed052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:28.714517 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede42e1-b423-4922-9dbe-8849e90ed052 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.714789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede42e1-b423-4922-9dbe-8849e90ed052 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.715050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede42e1-b423-4922-9dbe-8849e90ed052 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.716240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede42e1-b423-4922-9dbe-8849e90ed052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:28.717668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede42e1-b423-4922-9dbe-8849e90ed052 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:28.719492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 524/1025] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:28.724804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede42e1-b423-4922-9dbe-8849e90ed052 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:28.756226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17b99b-f442-41fd-89c8-95e51c956d4f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:28.791540 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:28.792470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.792657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.792925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] PATH_INFO: `/v3/services/image` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.793505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:28.794867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:28.807161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:28.808351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:28.814346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 502/1026] 10.222.0.93 () {56 vars in 1105 bytes} [Wed May 11 18:45:28 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:28.815499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:28.830060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede42e1-b423-4922-9dbe-8849e90ed052 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:28.864319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a0f58-b427-4c5b-b431-74a2dc39be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:28.864983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a0f58-b427-4c5b-b431-74a2dc39be9e None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.865263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a0f58-b427-4c5b-b431-74a2dc39be9e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.865539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a0f58-b427-4c5b-b431-74a2dc39be9e None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.866240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a0f58-b427-4c5b-b431-74a2dc39be9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:28.867699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a0f58-b427-4c5b-b431-74a2dc39be9e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:28.887613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 525/1027] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:45:28 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:28.915537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bf177-f86d-40e2-8985-65b6236d9edd None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:28.952046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:28.952740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:28.953023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:28.953296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:28.954040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] RBAC: Adding query filter params (name=image) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:28.954352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:28.955870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:28.961802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 503/1028] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:28.967553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a0f58-b427-4c5b-b431-74a2dc39be9e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:29.080483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a0f58-b427-4c5b-b431-74a2dc39be9e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:29.115441 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:29.116114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:29.116398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:29.116678 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:29.117785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] RBAC: Adding query filter params (type=image) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:29.117785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:29.119054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:29.124165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 526/1029] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:29.130174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:29.235807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394c793-ac19-4999-bad5-fe809ff34348 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:29.269389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d45b5-3b20-45bb-bfba-80ab89011ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:29.270042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d45b5-3b20-45bb-bfba-80ab89011ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:29.270314 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d45b5-3b20-45bb-bfba-80ab89011ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:29.270592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d45b5-3b20-45bb-bfba-80ab89011ac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:29.271382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d45b5-3b20-45bb-bfba-80ab89011ac7 None admin] RBAC: Adding query filter params (interface=public, service_id=6a0e85223f8049fd8317ed0d9c5ce9ae, region_id=RegionOne) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:29.271690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d45b5-3b20-45bb-bfba-80ab89011ac7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:29.273035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d45b5-3b20-45bb-bfba-80ab89011ac7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:29.278094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 504/1030] 10.222.0.93 () {56 vars in 1251 bytes} [Wed May 11 18:45:29 2022] GET /identity/v3/endpoints?service_id=6a0e85223f8049fd8317ed0d9c5ce9ae&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:29.283369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:29.378204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44605c93-39d1-48fb-b6eb-3afdfb61fbf1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:29.412635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854a943-3d29-4543-aba9-6dcf13705789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:29.413295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854a943-3d29-4543-aba9-6dcf13705789 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:29.413570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854a943-3d29-4543-aba9-6dcf13705789 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:29.413839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854a943-3d29-4543-aba9-6dcf13705789 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:29.414506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854a943-3d29-4543-aba9-6dcf13705789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:29.415912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854a943-3d29-4543-aba9-6dcf13705789 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:29.423877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 527/1031] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:45:29 2022] GET /identity/v3/services => generated 1957 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:45:30.543993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2ddd-e2f7-4b01-a5ae-070fc39a1f8b None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:30.544487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2ddd-e2f7-4b01-a5ae-070fc39a1f8b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:30.544487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2ddd-e2f7-4b01-a5ae-070fc39a1f8b None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:30.545952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 505/1032] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:30.551100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f2550-fcb1-4221-bccb-60183d177f74 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:30.551668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f2550-fcb1-4221-bccb-60183d177f74 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:30.551810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f2550-fcb1-4221-bccb-60183d177f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:30.570019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8c2f2550-fcb1-4221-bccb-60183d177f74 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:30.571205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8c2f2550-fcb1-4221-bccb-60183d177f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:30.635944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 528/1033] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:30.659905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a2ddd-e2f7-4b01-a5ae-070fc39a1f8b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:30.764546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a2ddd-e2f7-4b01-a5ae-070fc39a1f8b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:30.802408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334da5a1-da74-4505-a6ff-31100ae9a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:30.803212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334da5a1-da74-4505-a6ff-31100ae9a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:30.803735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334da5a1-da74-4505-a6ff-31100ae9a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:30.804022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334da5a1-da74-4505-a6ff-31100ae9a5f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:30.816182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334da5a1-da74-4505-a6ff-31100ae9a5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-334da5a1-da74-4505-a6ff-31100ae9a5f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:30.824342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:30.825223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:30.826060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:30.827582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 506/1034] 10.222.0.93 () {56 vars in 1120 bytes} [Wed May 11 18:45:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:30.831557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f2550-fcb1-4221-bccb-60183d177f74 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:30.925255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f2550-fcb1-4221-bccb-60183d177f74 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:30.958026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:30.958694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:30.958973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:30.959242 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:30.960001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:30.960304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:30.961658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:30.974033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 529/1035] 10.222.0.93 () {56 vars in 1115 bytes} [Wed May 11 18:45:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:30.975539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334da5a1-da74-4505-a6ff-31100ae9a5f1 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.080876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334da5a1-da74-4505-a6ff-31100ae9a5f1 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.114311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724fb8-e69e-4d6e-bc49-9f52cee633ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.115112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724fb8-e69e-4d6e-bc49-9f52cee633ad None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.115423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724fb8-e69e-4d6e-bc49-9f52cee633ad None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.115693 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724fb8-e69e-4d6e-bc49-9f52cee633ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.125439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68724fb8-e69e-4d6e-bc49-9f52cee633ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:31.126879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68724fb8-e69e-4d6e-bc49-9f52cee633ad None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-68724fb8-e69e-4d6e-bc49-9f52cee633ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:31.144106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:31.145023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:31.145924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:31.145924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:31.145924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:31.145924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:31.149884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 507/1036] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:31.151152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.207323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b599-314a-41e5-817e-75766cd61bc5 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.207560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b599-314a-41e5-817e-75766cd61bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.207812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b599-314a-41e5-817e-75766cd61bc5 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.209299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 508/1037] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:31.214549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617fc6-2aeb-4721-a5c5-21168bd572d1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.214833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617fc6-2aeb-4721-a5c5-21168bd572d1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.215109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617fc6-2aeb-4721-a5c5-21168bd572d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.233908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-e2617fc6-2aeb-4721-a5c5-21168bd572d1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:31.235077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e2617fc6-2aeb-4721-a5c5-21168bd572d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:31.253246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a734c2-803a-4bca-b0dc-cd4139039685 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.287393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.288062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.288342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.288617 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.289335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:31.289637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:31.291238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:31.302742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 509/1038] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:31.307726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 530/1039] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:31.309470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617fc6-2aeb-4721-a5c5-21168bd572d1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.325029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.406553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617fc6-2aeb-4721-a5c5-21168bd572d1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.422732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ae0b9-26c9-4d75-8f72-773109772470 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.442063 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.442876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.443149 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.443456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.451445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:31.452938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:31.459734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442d79b-ee64-4b90-989f-18dfeaecbd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.460565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d79b-ee64-4b90-989f-18dfeaecbd08 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.460849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d79b-ee64-4b90-989f-18dfeaecbd08 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.461149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d79b-ee64-4b90-989f-18dfeaecbd08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:31.469356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:31.470547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:45:31.472259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:31.473582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442d79b-ee64-4b90-989f-18dfeaecbd08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:31.474451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 510/1040] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:31.480313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-7442d79b-ee64-4b90-989f-18dfeaecbd08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:31.481386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:31.482294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:31.483185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 531/1041] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:31.491466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442d79b-ee64-4b90-989f-18dfeaecbd08 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.580341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0950c42-b3b9-4199-a4c2-7c83f591ff49 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.587279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442d79b-ee64-4b90-989f-18dfeaecbd08 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.614114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a07a3-b7ad-4bc2-ba11-5cb8661f3031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.614788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a07a3-b7ad-4bc2-ba11-5cb8661f3031 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.615067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a07a3-b7ad-4bc2-ba11-5cb8661f3031 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.615369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a07a3-b7ad-4bc2-ba11-5cb8661f3031 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.616209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a07a3-b7ad-4bc2-ba11-5cb8661f3031 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:31.616531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a07a3-b7ad-4bc2-ba11-5cb8661f3031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:31.617925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a07a3-b7ad-4bc2-ba11-5cb8661f3031 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:31.622810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.623738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.624230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.624739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.625691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:31.626216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:31.627722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:31.634753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 511/1042] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:31.640519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 532/1043] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:31.640647 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348ce0-a46e-46b7-9cd5-e5715cfc145d None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.640725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.640796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348ce0-a46e-46b7-9cd5-e5715cfc145d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.640880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348ce0-a46e-46b7-9cd5-e5715cfc145d None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.642155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 512/1044] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:31.642857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3348ce0-a46e-46b7-9cd5-e5715cfc145d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.735465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134d00-05d4-4429-9d67-e0d7e1a04a71 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.739865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3348ce0-a46e-46b7-9cd5-e5715cfc145d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.767205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fdbac-28d5-46a8-90c7-4fbb5cd5b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.768415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fdbac-28d5-46a8-90c7-4fbb5cd5b2dd None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.768659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fdbac-28d5-46a8-90c7-4fbb5cd5b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.768930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fdbac-28d5-46a8-90c7-4fbb5cd5b2dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.771687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee886a24-fe59-4cf0-9d06-8668590403b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.772547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886a24-fe59-4cf0-9d06-8668590403b9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.772828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886a24-fe59-4cf0-9d06-8668590403b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.773101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886a24-fe59-4cf0-9d06-8668590403b9 None admin] PATH_INFO: `/v3/users/8fbdbd668ff24e85b137feb95122236c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.786496 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee886a24-fe59-4cf0-9d06-8668590403b9 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbdbd668ff24e85b137feb95122236c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:31.787973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee886a24-fe59-4cf0-9d06-8668590403b9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:31.789659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 513/1045] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/users/8fbdbd668ff24e85b137feb95122236c => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:31.790928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835acbfe-27f6-47a1-bb07-850234ee2fa9 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.791208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835acbfe-27f6-47a1-bb07-850234ee2fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.791519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835acbfe-27f6-47a1-bb07-850234ee2fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:31.806445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-835acbfe-27f6-47a1-bb07-850234ee2fa9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:31.807647 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-835acbfe-27f6-47a1-bb07-850234ee2fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:31.834294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fdbac-28d5-46a8-90c7-4fbb5cd5b2dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:31.835770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fdbac-28d5-46a8-90c7-4fbb5cd5b2dd None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:31.870009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 514/1046] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:31.870825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835acbfe-27f6-47a1-bb07-850234ee2fa9 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.928926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 533/1047] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:31.929762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fdbac-28d5-46a8-90c7-4fbb5cd5b2dd None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:31.966357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835acbfe-27f6-47a1-bb07-850234ee2fa9 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:31.997602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac11e-2d69-442c-85f2-2ebd05cbd9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:31.998161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac11e-2d69-442c-85f2-2ebd05cbd9cf None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:31.998442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac11e-2d69-442c-85f2-2ebd05cbd9cf None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:31.998714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac11e-2d69-442c-85f2-2ebd05cbd9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.026331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fdbac-28d5-46a8-90c7-4fbb5cd5b2dd None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.057731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.058508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.058785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.059054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] PATH_INFO: `/v3/services/image` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.059746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.061099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.061865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ac11e-2d69-442c-85f2-2ebd05cbd9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.063305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ac11e-2d69-442c-85f2-2ebd05cbd9cf None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:32.073028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:32.074191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:32.075033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 534/1048] 10.222.0.93 () {56 vars in 1105 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:32.075909 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.159735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 515/1049] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:32.160557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac11e-2d69-442c-85f2-2ebd05cbd9cf None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.168252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b12a8-c45e-47fc-bb35-670483800d09 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.201129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.201944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.202227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.202497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.213025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.214473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:32.230873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:32.231775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:32.232650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:32.232650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:32.232650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:32.232650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:32.232650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 535/1050] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:32.232934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.258972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac11e-2d69-442c-85f2-2ebd05cbd9cf None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.291106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.291797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.292073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.292345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.293055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] RBAC: Adding query filter params (name=image) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:32.293356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.294712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.299939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 516/1051] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:32.300803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.328756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f53e-5773-4957-b6a3-797fc45402b6 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.363949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35d1d-e08e-409c-a5bb-2ef3657c6d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.364800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35d1d-e08e-409c-a5bb-2ef3657c6d2e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.365089 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35d1d-e08e-409c-a5bb-2ef3657c6d2e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.365351 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35d1d-e08e-409c-a5bb-2ef3657c6d2e None admin] PATH_INFO: `/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.366709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a35d1d-e08e-409c-a5bb-2ef3657c6d2e None admin] RBAC: Authorizing `identity:get_project(project_id=00deb15fe4da4f0b9cd3fc226934f95e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.368178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a35d1d-e08e-409c-a5bb-2ef3657c6d2e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.370129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 536/1052] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:32.370885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35d1d-e08e-409c-a5bb-2ef3657c6d2e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.403759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aaf27-f5d9-419b-aaee-7f4f34c90f6f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.436289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.436953 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.437229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.437498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.438210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:32.438510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.440691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.451503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 517/1053] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:32.452286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.466308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35d1d-e08e-409c-a5bb-2ef3657c6d2e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.498127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.498784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.499073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.499369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.500063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] RBAC: Adding query filter params (type=image) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:32.500366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.501742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.507032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 537/1054] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:32.507821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.547219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5512c-d33d-47d1-bb8a-f09e72a0178f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.578874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.579545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.579824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.580094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.580917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=00deb15fe4da4f0b9cd3fc226934f95e, user.id=8fbdbd668ff24e85b137feb95122236c) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:32.581444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.582622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.599329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 518/1055] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/role_assignments?user.id=8fbdbd668ff24e85b137feb95122236c&scope.project.id=00deb15fe4da4f0b9cd3fc226934f95e&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:32.599329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.605284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0899f-b07d-412c-b631-ab6989ecfd32 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.640945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.642166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.642654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.643185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.650924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.652558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:32.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:32.669453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:32.670614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 538/1056] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:32.678019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.698225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e766a22-4be1-4066-8917-1a167e43a13c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.734779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc0216-a671-4982-8489-ed335d7a2231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.735477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc0216-a671-4982-8489-ed335d7a2231 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.735817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc0216-a671-4982-8489-ed335d7a2231 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.736089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc0216-a671-4982-8489-ed335d7a2231 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.737436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc0216-a671-4982-8489-ed335d7a2231 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.738828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc0216-a671-4982-8489-ed335d7a2231 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.767550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 519/1057] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:45:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:45:32.784170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231f689-9feb-47ee-9570-370b2f160d29 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.831574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41cb17-95aa-456f-96d9-32fe5a9a4483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.832534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41cb17-95aa-456f-96d9-32fe5a9a4483 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.832818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41cb17-95aa-456f-96d9-32fe5a9a4483 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.833095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41cb17-95aa-456f-96d9-32fe5a9a4483 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.833892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41cb17-95aa-456f-96d9-32fe5a9a4483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:32.834202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41cb17-95aa-456f-96d9-32fe5a9a4483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.835688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41cb17-95aa-456f-96d9-32fe5a9a4483 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:32.849285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 539/1058] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:32.855508 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc0216-a671-4982-8489-ed335d7a2231 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:32.960876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc0216-a671-4982-8489-ed335d7a2231 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:32.995637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd595-0216-4b66-b06d-c02ca20e7830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:32.996291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd595-0216-4b66-b06d-c02ca20e7830 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:32.996566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd595-0216-4b66-b06d-c02ca20e7830 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:32.996836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd595-0216-4b66-b06d-c02ca20e7830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:32.998013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd595-0216-4b66-b06d-c02ca20e7830 None admin] RBAC: Adding query filter params (role.id=e777e59cb0244eb389b36ba001c3795c, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:32.998354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd595-0216-4b66-b06d-c02ca20e7830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:32.999853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd595-0216-4b66-b06d-c02ca20e7830 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:33.005897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 520/1059] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:32 2022] GET /identity/v3/role_assignments?user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e777e59cb0244eb389b36ba001c3795c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:34.785367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a6f6e-ba8f-4152-bb50-ed72177cfe60 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:34.785998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a6f6e-ba8f-4152-bb50-ed72177cfe60 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:34.785998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a6f6e-ba8f-4152-bb50-ed72177cfe60 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:34.787325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 540/1060] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:34.792363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7826cf-6162-43ca-9e20-3ef83f254732 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:34.792742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7826cf-6162-43ca-9e20-3ef83f254732 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:34.792899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7826cf-6162-43ca-9e20-3ef83f254732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:34.809090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-2d7826cf-6162-43ca-9e20-3ef83f254732 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:34.810249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2d7826cf-6162-43ca-9e20-3ef83f254732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:34.879918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 521/1061] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:34.902192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a6f6e-ba8f-4152-bb50-ed72177cfe60 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:34.998756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a6f6e-ba8f-4152-bb50-ed72177cfe60 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.032099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2dec0-c494-41fe-9e89-65465449700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.032927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2dec0-c494-41fe-9e89-65465449700e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.033204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2dec0-c494-41fe-9e89-65465449700e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.033508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2dec0-c494-41fe-9e89-65465449700e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.043567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae1def-80c9-4fc2-ad29-7f87cc2437a2 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.043855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae1def-80c9-4fc2-ad29-7f87cc2437a2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.044043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae1def-80c9-4fc2-ad29-7f87cc2437a2 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.045639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2dec0-c494-41fe-9e89-65465449700e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:35.045775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 522/1062] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:35.051349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e000f1-31f5-4d41-9052-e21f3c8fc169 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.051712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e000f1-31f5-4d41-9052-e21f3c8fc169 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.051890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e000f1-31f5-4d41-9052-e21f3c8fc169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-0ef2dec0-c494-41fe-9e89-65465449700e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:35.053261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:35.054377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:35.055423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:35.059744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 541/1063] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:35.060705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2dec0-c494-41fe-9e89-65465449700e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.072971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-19e000f1-31f5-4d41-9052-e21f3c8fc169 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:35.074380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-19e000f1-31f5-4d41-9052-e21f3c8fc169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:35.147366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 523/1064] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:35.158856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2dec0-c494-41fe-9e89-65465449700e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.162171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e000f1-31f5-4d41-9052-e21f3c8fc169 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.192974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.193638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.193916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.194188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.194924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:35.195226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:35.196622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:35.205009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 542/1065] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:35.210943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.263623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e000f1-31f5-4d41-9052-e21f3c8fc169 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.295913 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee449b1-ec23-4aed-bbff-be4b967a204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.296481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee449b1-ec23-4aed-bbff-be4b967a204a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.296757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee449b1-ec23-4aed-bbff-be4b967a204a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.297027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee449b1-ec23-4aed-bbff-be4b967a204a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.305631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de71353-da3e-49a2-9d1a-6ba1a0a48eee None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.337781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39145f1e-599b-41fb-97f9-8dbedd965fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.338637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145f1e-599b-41fb-97f9-8dbedd965fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.338915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145f1e-599b-41fb-97f9-8dbedd965fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.339183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145f1e-599b-41fb-97f9-8dbedd965fc9 None admin] PATH_INFO: `/v3/users/8fbdbd668ff24e85b137feb95122236c` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.340478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39145f1e-599b-41fb-97f9-8dbedd965fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbdbd668ff24e85b137feb95122236c)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:35.342003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39145f1e-599b-41fb-97f9-8dbedd965fc9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:35.343655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 543/1066] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/users/8fbdbd668ff24e85b137feb95122236c => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:35.344812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e9f11-5e07-49ca-8143-3ff032b2d187 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.345086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e9f11-5e07-49ca-8143-3ff032b2d187 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.345405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e9f11-5e07-49ca-8143-3ff032b2d187 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.346630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 544/1067] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:35.349337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e9f11-5e07-49ca-8143-3ff032b2d187 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.361376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee449b1-ec23-4aed-bbff-be4b967a204a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:35.363371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee449b1-ec23-4aed-bbff-be4b967a204a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:35.444887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e9f11-5e07-49ca-8143-3ff032b2d187 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.465744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 524/1068] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 18:45:35.467107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e24b-551d-4caf-9704-6a8a8c7da9b3 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.467321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e24b-551d-4caf-9704-6a8a8c7da9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.467591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e24b-551d-4caf-9704-6a8a8c7da9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.477844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93872f9f-afbd-4bc2-bba2-0b828bb8a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.478770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93872f9f-afbd-4bc2-bba2-0b828bb8a12f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.479051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93872f9f-afbd-4bc2-bba2-0b828bb8a12f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.479341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93872f9f-afbd-4bc2-bba2-0b828bb8a12f None admin] PATH_INFO: `/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.480510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93872f9f-afbd-4bc2-bba2-0b828bb8a12f None admin] RBAC: Authorizing `identity:get_project(project_id=00deb15fe4da4f0b9cd3fc226934f95e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:35.481941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93872f9f-afbd-4bc2-bba2-0b828bb8a12f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:35.483091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b899e24b-551d-4caf-9704-6a8a8c7da9b3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:35.488394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 545/1069] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:35.488554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b899e24b-551d-4caf-9704-6a8a8c7da9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:35.488657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93872f9f-afbd-4bc2-bba2-0b828bb8a12f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.546214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 525/1070] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:35.546980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e24b-551d-4caf-9704-6a8a8c7da9b3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.582376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93872f9f-afbd-4bc2-bba2-0b828bb8a12f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.614651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.615462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.615742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.616006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.625715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:35.627702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:35.638333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e24b-551d-4caf-9704-6a8a8c7da9b3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:35.645052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:35.646093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:35.647005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:35.647005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:35.647005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:35.647005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:35.647005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 546/1071] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:35.647005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.670182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4b2fd-15b7-44ce-a7b3-12197126f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.671062 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4b2fd-15b7-44ce-a7b3-12197126f2dc None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.671355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4b2fd-15b7-44ce-a7b3-12197126f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.671626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4b2fd-15b7-44ce-a7b3-12197126f2dc None admin] PATH_INFO: `/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e/users/8fbdbd668ff24e85b137feb95122236c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.673554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4b2fd-15b7-44ce-a7b3-12197126f2dc None admin] RBAC: Authorizing `identity:create_grant(project_id=00deb15fe4da4f0b9cd3fc226934f95e, user_id=8fbdbd668ff24e85b137feb95122236c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:35.674990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4b2fd-15b7-44ce-a7b3-12197126f2dc None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:35.687981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 526/1072] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:45:35 2022] PUT /identity/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e/users/8fbdbd668ff24e85b137feb95122236c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:45:35.688502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4b2fd-15b7-44ce-a7b3-12197126f2dc None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.753284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a67f9-dbe7-4e7f-aa4a-43bbfd0ab69f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.790457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eed01-5255-4230-991c-930651e9800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.791494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eed01-5255-4230-991c-930651e9800c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.791777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eed01-5255-4230-991c-930651e9800c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.792048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eed01-5255-4230-991c-930651e9800c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.793364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4b2fd-15b7-44ce-a7b3-12197126f2dc None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.803450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259eed01-5255-4230-991c-930651e9800c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-259eed01-5255-4230-991c-930651e9800c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:35.811823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:35.812848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:35.813665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:35.818784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 547/1073] 10.222.0.93 () {56 vars in 1120 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:35.820026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eed01-5255-4230-991c-930651e9800c None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:35.829837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.831073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.831392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.831666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.832394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:35.832697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:35.834082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:35.859547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 527/1074] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:35.928387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eed01-5255-4230-991c-930651e9800c None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:35.964531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:35.965208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:35.965486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:35.965778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:35.966535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:35.966836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:35.968285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:35.977091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 548/1075] 10.222.0.93 () {56 vars in 1115 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:35.983536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:36.086029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8dd2a-e44c-4157-850b-1f3c0355fbde None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:36.121322 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:36.122119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:36.122403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:36.122674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:36.133105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:36.134565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:36.153823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:36.154763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:36.155737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:36.155737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:36.155737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:36.155737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:36.155737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 528/1076] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:36.161494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:36.258314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1d16-5788-4c01-8423-cec3e6923264 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:36.290365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:36.291020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:36.291318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:36.291593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:36.292302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:36.292603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:36.293963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:36.305195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 549/1077] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:36.310689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:36.405146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772f423-c7a9-43bd-8c90-256e5ff6cca5 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:36.445920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:36.446701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:36.446974 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:36.447238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:36.454249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:36.456294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:36.470158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:36.471262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:36.472268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 529/1078] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:45:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:36.477080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:36.570201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed98a58-5c15-4fdb-8f04-e232ace135e9 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:36.601875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:36.602672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:36.602939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:36.603213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:36.604056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:36.604359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:36.605769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:36.621791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 550/1079] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:45:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:36.627847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:36.721002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc545d-2c02-4312-9c91-126fbc976c0a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:36.762817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:36.763643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:36.763923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:36.764192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:36.774136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:36.775598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:36.792412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:36.793281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:36.794628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:36.794628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:36.794628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:36.794628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:36.794628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 530/1080] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:36.800064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:36.897267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df5eb-e1ef-4d6a-b8f1-50acab246f25 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:36.929624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:36.930276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:36.930553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:36.930821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:36.931560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:36.931863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:36.933245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:36.945145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 551/1081] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:36.950884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:37.045106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6514-30d9-4602-9bfb-3a884f9e6542 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:37.078559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:37.079379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:37.079664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:37.079936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:37.087192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:37.088657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:37.102058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:37.102925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:37.104361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 531/1082] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:37.109104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:37.205100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a7944-50fc-43ab-adf9-e05209c51b35 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:37.238406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731e30d-d4b4-406a-a3e9-cdd902803ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:37.239064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731e30d-d4b4-406a-a3e9-cdd902803ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:37.239370 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731e30d-d4b4-406a-a3e9-cdd902803ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:37.239643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731e30d-d4b4-406a-a3e9-cdd902803ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:37.240417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731e30d-d4b4-406a-a3e9-cdd902803ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:37.240720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731e30d-d4b4-406a-a3e9-cdd902803ba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:37.242146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731e30d-d4b4-406a-a3e9-cdd902803ba6 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:37.253620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 552/1083] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:37.259521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:37.355373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c90b21-2613-4761-b6ec-5803b2184377 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:37.387625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e9640-54ab-496c-9d01-82bc40a03f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:37.388507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9640-54ab-496c-9d01-82bc40a03f6c None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:37.388786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9640-54ab-496c-9d01-82bc40a03f6c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:37.389056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9640-54ab-496c-9d01-82bc40a03f6c None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/aaff3fdfbc054b8f86a2f9aaa98a70cc/roles/e777e59cb0244eb389b36ba001c3795c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:37.391248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e9640-54ab-496c-9d01-82bc40a03f6c None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=aaff3fdfbc054b8f86a2f9aaa98a70cc, role_id=e777e59cb0244eb389b36ba001c3795c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:37.392701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e9640-54ab-496c-9d01-82bc40a03f6c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:37.405576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 532/1084] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:45:37 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/aaff3fdfbc054b8f86a2f9aaa98a70cc/roles/e777e59cb0244eb389b36ba001c3795c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:45:37.912678 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4ecb7-a8b8-492e-a136-8abaf6c8becf None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:37.913191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4ecb7-a8b8-492e-a136-8abaf6c8becf None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:37.913308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4ecb7-a8b8-492e-a136-8abaf6c8becf None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:37.914566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 553/1085] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:37.919732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d38d4-8904-472d-89ca-73385da17677 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:37.920110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d38d4-8904-472d-89ca-73385da17677 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:37.920287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d38d4-8904-472d-89ca-73385da17677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:37.936865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-322d38d4-8904-472d-89ca-73385da17677 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:37.938074 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-322d38d4-8904-472d-89ca-73385da17677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:38.002773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 533/1086] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:38.026450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4ecb7-a8b8-492e-a136-8abaf6c8becf None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:38.121874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4ecb7-a8b8-492e-a136-8abaf6c8becf None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:38.154586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbaae4-a4ee-439c-8d46-de3744f7baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:38.155414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbaae4-a4ee-439c-8d46-de3744f7baa1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:38.155694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbaae4-a4ee-439c-8d46-de3744f7baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:38.155964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbaae4-a4ee-439c-8d46-de3744f7baa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:38.165613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbaae4-a4ee-439c-8d46-de3744f7baa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-26dbaae4-a4ee-439c-8d46-de3744f7baa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:38.173160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:38.174585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:38.175461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 554/1087] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:38.180830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d38d4-8904-472d-89ca-73385da17677 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:38.275323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d38d4-8904-472d-89ca-73385da17677 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:38.307010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:38.307693 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:38.307972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:38.308240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:38.308973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:38.309276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:38.310653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:38.319264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 534/1088] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:45:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:38.324804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbaae4-a4ee-439c-8d46-de3744f7baa1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:38.419151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbaae4-a4ee-439c-8d46-de3744f7baa1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:38.451755 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7804407-fa7f-4683-9fce-15290c421c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:38.452618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7804407-fa7f-4683-9fce-15290c421c6e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:38.452898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7804407-fa7f-4683-9fce-15290c421c6e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:38.453171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7804407-fa7f-4683-9fce-15290c421c6e None admin] PATH_INFO: `/v3/users/8fbdbd668ff24e85b137feb95122236c` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:38.454357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7804407-fa7f-4683-9fce-15290c421c6e None admin] RBAC: Authorizing `identity:get_user(user_id=8fbdbd668ff24e85b137feb95122236c)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:38.455862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7804407-fa7f-4683-9fce-15290c421c6e None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:38.457686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 555/1089] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:38 2022] GET /identity/v3/users/8fbdbd668ff24e85b137feb95122236c => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:38.463089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:38.560183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921a115-4ed7-4058-b1dc-9bb97f69ba32 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:38.592177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b90ce8-8458-4f35-9827-ebd1e99e7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:38.592826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b90ce8-8458-4f35-9827-ebd1e99e7b11 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:38.593102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b90ce8-8458-4f35-9827-ebd1e99e7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:38.593369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b90ce8-8458-4f35-9827-ebd1e99e7b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:38.657225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b90ce8-8458-4f35-9827-ebd1e99e7b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:38.659162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b90ce8-8458-4f35-9827-ebd1e99e7b11 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:38.751415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 535/1090] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:38.757116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7804407-fa7f-4683-9fce-15290c421c6e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:38.851198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7804407-fa7f-4683-9fce-15290c421c6e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:38.883658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48ebad-7bf0-4b6e-9549-670095af98a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:38.884491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ebad-7bf0-4b6e-9549-670095af98a0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:38.884772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ebad-7bf0-4b6e-9549-670095af98a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:38.885055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48ebad-7bf0-4b6e-9549-670095af98a0 None admin] PATH_INFO: `/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:38.886225 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48ebad-7bf0-4b6e-9549-670095af98a0 None admin] RBAC: Authorizing `identity:get_project(project_id=00deb15fe4da4f0b9cd3fc226934f95e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:38.887690 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48ebad-7bf0-4b6e-9549-670095af98a0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:38.889554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 556/1091] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:45:38 2022] GET /identity/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:38.898172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b90ce8-8458-4f35-9827-ebd1e99e7b11 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:38.994389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b90ce8-8458-4f35-9827-ebd1e99e7b11 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:39.026559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4fbe5-2733-442f-a215-637d2542921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:39.027136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4fbe5-2733-442f-a215-637d2542921a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:39.027453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4fbe5-2733-442f-a215-637d2542921a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:39.027720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4fbe5-2733-442f-a215-637d2542921a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:39.028541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4fbe5-2733-442f-a215-637d2542921a None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=00deb15fe4da4f0b9cd3fc226934f95e, user.id=8fbdbd668ff24e85b137feb95122236c) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:39.028844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4fbe5-2733-442f-a215-637d2542921a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:39.030261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4fbe5-2733-442f-a215-637d2542921a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:39.036656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 536/1092] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:38 2022] GET /identity/v3/role_assignments?user.id=8fbdbd668ff24e85b137feb95122236c&scope.project.id=00deb15fe4da4f0b9cd3fc226934f95e&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:39.637512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731e98-f04b-48bd-8263-ecfbf08c1252 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:39.638042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731e98-f04b-48bd-8263-ecfbf08c1252 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:39.638042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731e98-f04b-48bd-8263-ecfbf08c1252 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:39.639464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 557/1093] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:39.644718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ac0d-2885-43bf-84cf-16e0417275d8 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:39.645008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ac0d-2885-43bf-84cf-16e0417275d8 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:39.645284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ac0d-2885-43bf-84cf-16e0417275d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:39.662053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-2bd6ac0d-2885-43bf-84cf-16e0417275d8 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:39.663223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2bd6ac0d-2885-43bf-84cf-16e0417275d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:39.727083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 537/1094] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:39.750136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731e98-f04b-48bd-8263-ecfbf08c1252 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:39.847312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731e98-f04b-48bd-8263-ecfbf08c1252 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:39.878826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6634bf-675c-4955-9824-f854634b3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:39.879652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6634bf-675c-4955-9824-f854634b3a95 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:39.879929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6634bf-675c-4955-9824-f854634b3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:39.880196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6634bf-675c-4955-9824-f854634b3a95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:39.889960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6634bf-675c-4955-9824-f854634b3a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-6e6634bf-675c-4955-9824-f854634b3a95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:39.898567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:39.899701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:39.900574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 558/1095] 10.222.0.93 () {56 vars in 1120 bytes} [Wed May 11 18:45:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:39.905708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6ac0d-2885-43bf-84cf-16e0417275d8 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:40.000724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6ac0d-2885-43bf-84cf-16e0417275d8 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:40.032853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:40.033556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:40.033837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:40.034108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:40.034846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:40.035152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:40.036547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:40.044459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 538/1096] 10.222.0.93 () {56 vars in 1115 bytes} [Wed May 11 18:45:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:40.049932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6634bf-675c-4955-9824-f854634b3a95 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:40.144412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6634bf-675c-4955-9824-f854634b3a95 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:40.175470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:40.176295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:40.176573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:40.176844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:40.188282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:40.190270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:40.207620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:40.208636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:40.209544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:40.209544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:40.209544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:40.209544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:40.209544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 559/1097] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:40.214524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:40.307868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765d621-ad7a-4d76-9d56-711edc9621f8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:40.339583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:40.340237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:40.340509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:40.340774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:40.341490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:40.341786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:40.343124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:40.354274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 539/1098] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:40.359859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:40.457505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ad1c3-543b-4243-84c0-53c1715ffa35 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:40.489472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:40.490265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:40.490548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:40.490819 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:40.498644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:40.500107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:45:40.513640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:40.514724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:40.515733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 560/1099] 10.222.0.93 () {56 vars in 1093 bytes} [Wed May 11 18:45:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:40.521023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:40.614966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e53beb-6297-4192-a23b-55ef0af6e641 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:40.648077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87436113-e817-4094-8e29-4e4937a399db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:40.648741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87436113-e817-4094-8e29-4e4937a399db None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:40.649023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87436113-e817-4094-8e29-4e4937a399db None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:40.649297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87436113-e817-4094-8e29-4e4937a399db None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:40.650129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87436113-e817-4094-8e29-4e4937a399db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:40.650437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87436113-e817-4094-8e29-4e4937a399db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:40.651906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87436113-e817-4094-8e29-4e4937a399db None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:40.669002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 540/1100] 10.222.0.93 () {56 vars in 1133 bytes} [Wed May 11 18:45:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:40.674675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:40.770241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8a89-4a51-40b8-a9ad-eb3093af7650 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:40.802506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2b5d-34b5-4edd-9e95-5b49995bd4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:40.803162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2b5d-34b5-4edd-9e95-5b49995bd4ef None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:40.803484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2b5d-34b5-4edd-9e95-5b49995bd4ef None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:40.803761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2b5d-34b5-4edd-9e95-5b49995bd4ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:40.867308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2b5d-34b5-4edd-9e95-5b49995bd4ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:40.868775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2b5d-34b5-4edd-9e95-5b49995bd4ef None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:40.965651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 561/1101] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:40.971802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87436113-e817-4094-8e29-4e4937a399db None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:41.064234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87436113-e817-4094-8e29-4e4937a399db None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:41.095276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:41.096595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.096872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.097134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.107456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:41.108936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:45:41.128202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:41.129246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:41.130150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:45:41.130150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:45:41.130150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:45:41.130150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:41.130150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 541/1102] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:45:41.135406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2b5d-34b5-4edd-9e95-5b49995bd4ef None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:41.234986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2b5d-34b5-4edd-9e95-5b49995bd4ef None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:41.266539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973aa96-3cbd-4bf3-aa96-40b89d4ec80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:41.267191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973aa96-3cbd-4bf3-aa96-40b89d4ec80b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.267506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973aa96-3cbd-4bf3-aa96-40b89d4ec80b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.268292 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973aa96-3cbd-4bf3-aa96-40b89d4ec80b None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.269007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973aa96-3cbd-4bf3-aa96-40b89d4ec80b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:41.269309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973aa96-3cbd-4bf3-aa96-40b89d4ec80b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:41.270664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973aa96-3cbd-4bf3-aa96-40b89d4ec80b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:41.281387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 562/1103] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:41.287547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:41.300888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cf8e-8c16-4a24-aff8-e6c50d1b8084 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.301174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cf8e-8c16-4a24-aff8-e6c50d1b8084 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.301448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cf8e-8c16-4a24-aff8-e6c50d1b8084 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.302787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 563/1104] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:45:41.307693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92a95-30b8-4bdd-886c-42bf2a4a0091 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.307979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92a95-30b8-4bdd-886c-42bf2a4a0091 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.308253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92a95-30b8-4bdd-886c-42bf2a4a0091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.324357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c2e92a95-30b8-4bdd-886c-42bf2a4a0091 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:41.325477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c2e92a95-30b8-4bdd-886c-42bf2a4a0091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:41.380729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666962dc-c9c7-4254-a063-2029d047530d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:41.387373 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 564/1105] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:41.412385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e92a95-30b8-4bdd-886c-42bf2a4a0091 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:41.413972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:41.414752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.415025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.415311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.421770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:41.423246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:45:41.436623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:41.437582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:45:41.438616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 542/1106] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:41.443764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:41.505834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e92a95-30b8-4bdd-886c-42bf2a4a0091 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:41.538146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681a94f-e7cc-4ca1-a767-5dce2ac67c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:41.538578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3ace4-886e-4f96-a34c-dc8a4e109a99 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:41.538938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a94f-e7cc-4ca1-a767-5dce2ac67c15 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.539217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a94f-e7cc-4ca1-a767-5dce2ac67c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.539519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681a94f-e7cc-4ca1-a767-5dce2ac67c15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.540672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681a94f-e7cc-4ca1-a767-5dce2ac67c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:41.542098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681a94f-e7cc-4ca1-a767-5dce2ac67c15 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:41.543824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 565/1107] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:41.549426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681a94f-e7cc-4ca1-a767-5dce2ac67c15 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:41.570587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:41.571235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.571539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.571807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.572580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:41.572884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:41.574286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:41.586597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 543/1108] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:45:41.592681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:41.643542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681a94f-e7cc-4ca1-a767-5dce2ac67c15 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:41.675150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296821a-0f58-4666-941a-46331b7c4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:41.675841 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296821a-0f58-4666-941a-46331b7c4990 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.676120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296821a-0f58-4666-941a-46331b7c4990 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.676389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296821a-0f58-4666-941a-46331b7c4990 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.677079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296821a-0f58-4666-941a-46331b7c4990 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:41.678498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296821a-0f58-4666-941a-46331b7c4990 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:41.692901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941571cc-309f-48a3-ae84-696325b7ec80 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:41.704808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 566/1109] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:45:41 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:41.728060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09bfaa-e2d5-467f-b310-ce29284c0566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:41.728739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09bfaa-e2d5-467f-b310-ce29284c0566 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:41.729020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09bfaa-e2d5-467f-b310-ce29284c0566 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:41.729294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09bfaa-e2d5-467f-b310-ce29284c0566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:41.730155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09bfaa-e2d5-467f-b310-ce29284c0566 None admin] RBAC: Adding query filter params (role.id=e777e59cb0244eb389b36ba001c3795c, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:41.730470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09bfaa-e2d5-467f-b310-ce29284c0566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:41.731979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09bfaa-e2d5-467f-b310-ce29284c0566 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:41.738596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 544/1110] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:41 2022] GET /identity/v3/role_assignments?user.id=aaff3fdfbc054b8f86a2f9aaa98a70cc&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e777e59cb0244eb389b36ba001c3795c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:43.991393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1003-08d0-41a5-96b6-17b8d65c92dd None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:43.991980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1003-08d0-41a5-96b6-17b8d65c92dd None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:43.991980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1003-08d0-41a5-96b6-17b8d65c92dd None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:43.993285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 567/1111] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:43.998474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b635-fc5a-468c-88b1-95251389d280 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:43.998863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b635-fc5a-468c-88b1-95251389d280 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:43.999015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b635-fc5a-468c-88b1-95251389d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:44.015138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-28a1b635-fc5a-468c-88b1-95251389d280 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:44.016339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-28a1b635-fc5a-468c-88b1-95251389d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:44.078183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 545/1112] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:44.104805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f1003-08d0-41a5-96b6-17b8d65c92dd None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:44.201887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f1003-08d0-41a5-96b6-17b8d65c92dd None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:44.234435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04d40f-8996-454e-8be5-3f814f87b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:44.235272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04d40f-8996-454e-8be5-3f814f87b862 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:44.235581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04d40f-8996-454e-8be5-3f814f87b862 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:44.235852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04d40f-8996-454e-8be5-3f814f87b862 None admin] PATH_INFO: `/v3/roles/b522cd7d0a2e4208bd451e2a39c97d63` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:44.237327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04d40f-8996-454e-8be5-3f814f87b862 None admin] RBAC: Authorizing `identity:get_role(role_id=b522cd7d0a2e4208bd451e2a39c97d63)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:44.238694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04d40f-8996-454e-8be5-3f814f87b862 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:44.240081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 568/1113] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:44 2022] GET /identity/v3/roles/b522cd7d0a2e4208bd451e2a39c97d63 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:44.245897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b635-fc5a-468c-88b1-95251389d280 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:44.338122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b635-fc5a-468c-88b1-95251389d280 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:44.369665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1673b-da21-4548-ade6-a80352e2384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:44.370512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1673b-da21-4548-ade6-a80352e2384f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:44.370791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1673b-da21-4548-ade6-a80352e2384f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:44.371063 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1673b-da21-4548-ade6-a80352e2384f None admin] PATH_INFO: `/v3/users/401a3e9e1a474b87b6307709031b42c2` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:44.383416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1673b-da21-4548-ade6-a80352e2384f None admin] RBAC: Authorizing `identity:get_user(user_id=401a3e9e1a474b87b6307709031b42c2)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:44.384847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1673b-da21-4548-ade6-a80352e2384f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:44.386455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 546/1114] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:44 2022] GET /identity/v3/users/401a3e9e1a474b87b6307709031b42c2 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:44.391936 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04d40f-8996-454e-8be5-3f814f87b862 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:44.493751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04d40f-8996-454e-8be5-3f814f87b862 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:44.526540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd79032-30b1-4aeb-8f77-2a0e39bd2d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:44.527123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd79032-30b1-4aeb-8f77-2a0e39bd2d0f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:44.527438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd79032-30b1-4aeb-8f77-2a0e39bd2d0f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:44.527714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd79032-30b1-4aeb-8f77-2a0e39bd2d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:44.590727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd79032-30b1-4aeb-8f77-2a0e39bd2d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:44.592191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd79032-30b1-4aeb-8f77-2a0e39bd2d0f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:44.682908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 569/1115] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:44.688782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1673b-da21-4548-ade6-a80352e2384f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:44.783701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1673b-da21-4548-ade6-a80352e2384f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:44.816517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0e3fe-3bf2-4d43-81d4-b7c7a4f0489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:44.817367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e3fe-3bf2-4d43-81d4-b7c7a4f0489a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:44.817642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e3fe-3bf2-4d43-81d4-b7c7a4f0489a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:44.817907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e3fe-3bf2-4d43-81d4-b7c7a4f0489a None admin] PATH_INFO: `/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:44.819051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0e3fe-3bf2-4d43-81d4-b7c7a4f0489a None admin] RBAC: Authorizing `identity:get_project(project_id=00deb15fe4da4f0b9cd3fc226934f95e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:44.820494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0e3fe-3bf2-4d43-81d4-b7c7a4f0489a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:44.822173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 547/1116] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:45:44 2022] GET /identity/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:44.828295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd79032-30b1-4aeb-8f77-2a0e39bd2d0f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:44.920867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd79032-30b1-4aeb-8f77-2a0e39bd2d0f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:44.953259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39526d7a-45f5-468f-9c09-935d6063aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:44.953904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39526d7a-45f5-468f-9c09-935d6063aa1d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:44.954187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39526d7a-45f5-468f-9c09-935d6063aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:44.954462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39526d7a-45f5-468f-9c09-935d6063aa1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:44.955330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39526d7a-45f5-468f-9c09-935d6063aa1d None admin] RBAC: Adding query filter params (role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=00deb15fe4da4f0b9cd3fc226934f95e, user.id=401a3e9e1a474b87b6307709031b42c2) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:44.955642 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39526d7a-45f5-468f-9c09-935d6063aa1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:44.957066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39526d7a-45f5-468f-9c09-935d6063aa1d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:44.962225 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 570/1117] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:44 2022] GET /identity/v3/role_assignments?user.id=401a3e9e1a474b87b6307709031b42c2&scope.project.id=00deb15fe4da4f0b9cd3fc226934f95e&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:47.148890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8f344-b05f-4b76-8568-a703c838e85f None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:47.149448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8f344-b05f-4b76-8568-a703c838e85f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:47.149448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8f344-b05f-4b76-8568-a703c838e85f None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:47.150764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 548/1118] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:47.156053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f14a2-0e13-4b89-90e7-a6592ee7bfa5 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:47.156450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f14a2-0e13-4b89-90e7-a6592ee7bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:47.156614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f14a2-0e13-4b89-90e7-a6592ee7bfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:47.174658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-6d9f14a2-0e13-4b89-90e7-a6592ee7bfa5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:47.175869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6d9f14a2-0e13-4b89-90e7-a6592ee7bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:47.240208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 571/1119] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:47.262207 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8f344-b05f-4b76-8568-a703c838e85f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:47.356653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8f344-b05f-4b76-8568-a703c838e85f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:47.387307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5ca3-8e10-4ac1-98b5-b05199284da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:47.388153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5ca3-8e10-4ac1-98b5-b05199284da1 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:47.388425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5ca3-8e10-4ac1-98b5-b05199284da1 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:47.388688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5ca3-8e10-4ac1-98b5-b05199284da1 None admin] PATH_INFO: `/v3/roles/b522cd7d0a2e4208bd451e2a39c97d63` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:47.390109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5ca3-8e10-4ac1-98b5-b05199284da1 None admin] RBAC: Authorizing `identity:get_role(role_id=b522cd7d0a2e4208bd451e2a39c97d63)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:47.391478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5ca3-8e10-4ac1-98b5-b05199284da1 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:47.393319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 549/1120] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:47 2022] GET /identity/v3/roles/b522cd7d0a2e4208bd451e2a39c97d63 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:47.398980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f14a2-0e13-4b89-90e7-a6592ee7bfa5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:47.491400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f14a2-0e13-4b89-90e7-a6592ee7bfa5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:47.523068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e88b1-2657-4007-a297-ce399bae168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:47.523951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e88b1-2657-4007-a297-ce399bae168b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:47.524231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e88b1-2657-4007-a297-ce399bae168b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:47.524499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e88b1-2657-4007-a297-ce399bae168b None admin] PATH_INFO: `/v3/users/401a3e9e1a474b87b6307709031b42c2` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:47.525667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e88b1-2657-4007-a297-ce399bae168b None admin] RBAC: Authorizing `identity:get_user(user_id=401a3e9e1a474b87b6307709031b42c2)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:47.527098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e88b1-2657-4007-a297-ce399bae168b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:47.528879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 572/1121] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:47 2022] GET /identity/v3/users/401a3e9e1a474b87b6307709031b42c2 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:47.535362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5ca3-8e10-4ac1-98b5-b05199284da1 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:47.627500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5ca3-8e10-4ac1-98b5-b05199284da1 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:47.658656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca6abf-3717-4765-a7d6-8a0974f136bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:47.659461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca6abf-3717-4765-a7d6-8a0974f136bd None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:47.659737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca6abf-3717-4765-a7d6-8a0974f136bd None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:47.660002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca6abf-3717-4765-a7d6-8a0974f136bd None admin] PATH_INFO: `/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:47.661141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca6abf-3717-4765-a7d6-8a0974f136bd None admin] RBAC: Authorizing `identity:get_project(project_id=00deb15fe4da4f0b9cd3fc226934f95e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:47.662531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca6abf-3717-4765-a7d6-8a0974f136bd None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:47.664193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 550/1122] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:45:47 2022] GET /identity/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:47.669753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e88b1-2657-4007-a297-ce399bae168b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:47.771251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e88b1-2657-4007-a297-ce399bae168b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:47.803017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bc8a8-9d87-4f35-b7d1-bb0a077199b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:47.803926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bc8a8-9d87-4f35-b7d1-bb0a077199b1 None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:47.804202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bc8a8-9d87-4f35-b7d1-bb0a077199b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:47.804473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bc8a8-9d87-4f35-b7d1-bb0a077199b1 None admin] PATH_INFO: `/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e/users/401a3e9e1a474b87b6307709031b42c2/roles/b522cd7d0a2e4208bd451e2a39c97d63` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:47.806615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bc8a8-9d87-4f35-b7d1-bb0a077199b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=00deb15fe4da4f0b9cd3fc226934f95e, user_id=401a3e9e1a474b87b6307709031b42c2, role_id=b522cd7d0a2e4208bd451e2a39c97d63)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:47.808117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bc8a8-9d87-4f35-b7d1-bb0a077199b1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:47.820903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 573/1123] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:45:47 2022] PUT /identity/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e/users/401a3e9e1a474b87b6307709031b42c2/roles/b522cd7d0a2e4208bd451e2a39c97d63 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:45:49.988071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8f15-46fd-4e5a-b2f9-af27307b087a None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:49.988602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8f15-46fd-4e5a-b2f9-af27307b087a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:49.988602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8f15-46fd-4e5a-b2f9-af27307b087a None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:49.989951 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 551/1124] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:49.995047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797096a-dcca-4ed6-8d8c-cee462b0cffb None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:49.995485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797096a-dcca-4ed6-8d8c-cee462b0cffb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:49.995635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797096a-dcca-4ed6-8d8c-cee462b0cffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:50.012689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d797096a-dcca-4ed6-8d8c-cee462b0cffb None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:50.013868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d797096a-dcca-4ed6-8d8c-cee462b0cffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:50.076134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 574/1125] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:50.099730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c8f15-46fd-4e5a-b2f9-af27307b087a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:50.194809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c8f15-46fd-4e5a-b2f9-af27307b087a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:50.226561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f934bff-a115-4c1b-8ce1-9939d5920f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:50.227449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934bff-a115-4c1b-8ce1-9939d5920f39 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:50.227730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934bff-a115-4c1b-8ce1-9939d5920f39 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:50.228004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934bff-a115-4c1b-8ce1-9939d5920f39 None admin] PATH_INFO: `/v3/roles/b522cd7d0a2e4208bd451e2a39c97d63` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:50.229460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f934bff-a115-4c1b-8ce1-9939d5920f39 None admin] RBAC: Authorizing `identity:get_role(role_id=b522cd7d0a2e4208bd451e2a39c97d63)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:50.230813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f934bff-a115-4c1b-8ce1-9939d5920f39 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:50.232219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 552/1126] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:50 2022] GET /identity/v3/roles/b522cd7d0a2e4208bd451e2a39c97d63 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:50.238458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797096a-dcca-4ed6-8d8c-cee462b0cffb None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:50.330962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797096a-dcca-4ed6-8d8c-cee462b0cffb None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:50.362489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c5b13-5704-4eab-bee1-03d1aafa37b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:50.363370 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c5b13-5704-4eab-bee1-03d1aafa37b2 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:50.363651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c5b13-5704-4eab-bee1-03d1aafa37b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:50.363920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c5b13-5704-4eab-bee1-03d1aafa37b2 None admin] PATH_INFO: `/v3/users/401a3e9e1a474b87b6307709031b42c2` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:50.365078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c5b13-5704-4eab-bee1-03d1aafa37b2 None admin] RBAC: Authorizing `identity:get_user(user_id=401a3e9e1a474b87b6307709031b42c2)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:50.366499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c5b13-5704-4eab-bee1-03d1aafa37b2 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:50.368120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 575/1127] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:50 2022] GET /identity/v3/users/401a3e9e1a474b87b6307709031b42c2 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:50.373789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f934bff-a115-4c1b-8ce1-9939d5920f39 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:50.467737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f934bff-a115-4c1b-8ce1-9939d5920f39 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:50.499552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d757c-f190-4621-b7e9-d6363dace330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:50.500124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d757c-f190-4621-b7e9-d6363dace330 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:50.500405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d757c-f190-4621-b7e9-d6363dace330 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:50.500677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d757c-f190-4621-b7e9-d6363dace330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:50.563457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d757c-f190-4621-b7e9-d6363dace330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:50.565635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d757c-f190-4621-b7e9-d6363dace330 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:50.656428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 553/1128] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 18:45:50.662204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c5b13-5704-4eab-bee1-03d1aafa37b2 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:50.755181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c5b13-5704-4eab-bee1-03d1aafa37b2 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:50.786715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c88ed-ef36-4be6-a2f5-88d57d3b4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:50.787580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c88ed-ef36-4be6-a2f5-88d57d3b4c8a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:50.787858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c88ed-ef36-4be6-a2f5-88d57d3b4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:50.788127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c88ed-ef36-4be6-a2f5-88d57d3b4c8a None admin] PATH_INFO: `/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:50.789283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c88ed-ef36-4be6-a2f5-88d57d3b4c8a None admin] RBAC: Authorizing `identity:get_project(project_id=00deb15fe4da4f0b9cd3fc226934f95e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:50.790713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c88ed-ef36-4be6-a2f5-88d57d3b4c8a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:50.792414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 576/1129] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:45:50 2022] GET /identity/v3/projects/00deb15fe4da4f0b9cd3fc226934f95e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:50.798396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d757c-f190-4621-b7e9-d6363dace330 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:50.891850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d757c-f190-4621-b7e9-d6363dace330 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:50.924639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e69bf4-163c-4cc5-85b6-0cda18471357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:50.925269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e69bf4-163c-4cc5-85b6-0cda18471357 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:50.925548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e69bf4-163c-4cc5-85b6-0cda18471357 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:50.925817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e69bf4-163c-4cc5-85b6-0cda18471357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:50.926634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e69bf4-163c-4cc5-85b6-0cda18471357 None admin] RBAC: Adding query filter params (role.id=b522cd7d0a2e4208bd451e2a39c97d63, scope.project.id=00deb15fe4da4f0b9cd3fc226934f95e, user.id=401a3e9e1a474b87b6307709031b42c2) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:50.926941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e69bf4-163c-4cc5-85b6-0cda18471357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:50.928382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e69bf4-163c-4cc5-85b6-0cda18471357 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:50.933950 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 554/1130] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:50 2022] GET /identity/v3/role_assignments?user.id=401a3e9e1a474b87b6307709031b42c2&scope.project.id=00deb15fe4da4f0b9cd3fc226934f95e&role.id=b522cd7d0a2e4208bd451e2a39c97d63 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:53.153969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38affe-67f0-41fd-8b80-7742b2d81c56 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:53.154505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38affe-67f0-41fd-8b80-7742b2d81c56 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:53.154505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38affe-67f0-41fd-8b80-7742b2d81c56 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:53.155901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 577/1131] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:53.161713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9200-97a2-408a-a362-7c1b0f361e4c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:53.162138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9200-97a2-408a-a362-7c1b0f361e4c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:53.162266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9200-97a2-408a-a362-7c1b0f361e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:53.179016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4ffa9200-97a2-408a-a362-7c1b0f361e4c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:53.180228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4ffa9200-97a2-408a-a362-7c1b0f361e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:53.243813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 555/1132] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:45:53.266885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38affe-67f0-41fd-8b80-7742b2d81c56 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:53.363802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38affe-67f0-41fd-8b80-7742b2d81c56 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:53.395379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911d4a5-3d12-4da7-a016-21f7d4174b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:53.396153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d4a5-3d12-4da7-a016-21f7d4174b5b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:53.396433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d4a5-3d12-4da7-a016-21f7d4174b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:53.396704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d4a5-3d12-4da7-a016-21f7d4174b5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:53.397908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911d4a5-3d12-4da7-a016-21f7d4174b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:53.399370 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911d4a5-3d12-4da7-a016-21f7d4174b5b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:53.400970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 578/1133] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:53.406734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9200-97a2-408a-a362-7c1b0f361e4c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:53.499826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9200-97a2-408a-a362-7c1b0f361e4c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:53.530869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17fecd-b38e-472b-858c-e3edae0bece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:53.531530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fecd-b38e-472b-858c-e3edae0bece4 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:53.531805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fecd-b38e-472b-858c-e3edae0bece4 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:53.532069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17fecd-b38e-472b-858c-e3edae0bece4 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:53.532806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17fecd-b38e-472b-858c-e3edae0bece4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:53.534777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17fecd-b38e-472b-858c-e3edae0bece4 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:53.557740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 556/1134] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:45:53 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:45:55.804915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97370961-e887-462e-b9c6-0bbd660f3f0e None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:55.805439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97370961-e887-462e-b9c6-0bbd660f3f0e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:55.805439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97370961-e887-462e-b9c6-0bbd660f3f0e None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:55.806811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 579/1135] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:55.812014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53755b-7de4-458b-94fc-349af6ebbc54 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:55.812424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53755b-7de4-458b-94fc-349af6ebbc54 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:55.812576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53755b-7de4-458b-94fc-349af6ebbc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:55.829095 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-de53755b-7de4-458b-94fc-349af6ebbc54 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:55.830273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-de53755b-7de4-458b-94fc-349af6ebbc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:55.895729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 557/1136] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:55.920732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97370961-e887-462e-b9c6-0bbd660f3f0e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:56.016016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97370961-e887-462e-b9c6-0bbd660f3f0e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:56.047433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d683e3f-ffca-479c-86cc-dbc051707f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:56.048200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683e3f-ffca-479c-86cc-dbc051707f38 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:56.049024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683e3f-ffca-479c-86cc-dbc051707f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:56.049297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683e3f-ffca-479c-86cc-dbc051707f38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:56.050446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d683e3f-ffca-479c-86cc-dbc051707f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:56.051894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d683e3f-ffca-479c-86cc-dbc051707f38 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:56.053467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 580/1137] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:56.059040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53755b-7de4-458b-94fc-349af6ebbc54 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:56.150221 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53755b-7de4-458b-94fc-349af6ebbc54 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:56.182252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0a3a7-0a7d-472d-8f06-5db9106e9d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:56.182907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0a3a7-0a7d-472d-8f06-5db9106e9d00 None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:56.183183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0a3a7-0a7d-472d-8f06-5db9106e9d00 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:56.183479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0a3a7-0a7d-472d-8f06-5db9106e9d00 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:56.184186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0a3a7-0a7d-472d-8f06-5db9106e9d00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:56.185589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0a3a7-0a7d-472d-8f06-5db9106e9d00 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:56.205654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 558/1138] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:45:56 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:45:58.453105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ef7de-4e04-470e-bf17-fefc960a531a None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:58.453639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ef7de-4e04-470e-bf17-fefc960a531a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:58.453639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ef7de-4e04-470e-bf17-fefc960a531a None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:58.455557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 581/1139] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:45:58.460883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a98487-3eba-458a-b580-0112de1854c2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:58.461271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a98487-3eba-458a-b580-0112de1854c2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:58.461362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a98487-3eba-458a-b580-0112de1854c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:58.478146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-63a98487-3eba-458a-b580-0112de1854c2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:45:58.479330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-63a98487-3eba-458a-b580-0112de1854c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:45:58.546099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 559/1140] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:45:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:45:58.569558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ef7de-4e04-470e-bf17-fefc960a531a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:58.665501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ef7de-4e04-470e-bf17-fefc960a531a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:58.696787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84bc8c-5892-448e-8493-cfaeff050809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:58.697553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84bc8c-5892-448e-8493-cfaeff050809 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:58.697835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84bc8c-5892-448e-8493-cfaeff050809 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:58.698109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84bc8c-5892-448e-8493-cfaeff050809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:58.708281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84bc8c-5892-448e-8493-cfaeff050809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-2f84bc8c-5892-448e-8493-cfaeff050809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:45:58.715955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:45:58.717122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:45:58.718365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 582/1141] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:45:58.723540 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a98487-3eba-458a-b580-0112de1854c2 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:58.815815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a98487-3eba-458a-b580-0112de1854c2 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:58.847232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:58.847904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:58.848181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:58.848451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:58.849185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:58.849484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:58.850847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:58.858420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 560/1142] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:58.863987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84bc8c-5892-448e-8493-cfaeff050809 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:58.957482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84bc8c-5892-448e-8493-cfaeff050809 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:58.988029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2df2f0-4fa2-4b79-b48f-fa50f133491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:58.988817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2df2f0-4fa2-4b79-b48f-fa50f133491d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:58.989090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2df2f0-4fa2-4b79-b48f-fa50f133491d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:58.989357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2df2f0-4fa2-4b79-b48f-fa50f133491d None admin] PATH_INFO: `/v3/users/131c43e0790b446fb35db3d7a6772240` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:59.002422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2df2f0-4fa2-4b79-b48f-fa50f133491d None admin] RBAC: Authorizing `identity:get_user(user_id=131c43e0790b446fb35db3d7a6772240)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:59.003868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2df2f0-4fa2-4b79-b48f-fa50f133491d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:59.005601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 583/1143] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:45:58 2022] GET /identity/v3/users/131c43e0790b446fb35db3d7a6772240 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:59.010941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:59.104961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b224-7497-4b0d-841e-f334713c9f88 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:59.143694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c790e-e992-476a-9030-957a579b966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:59.144327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c790e-e992-476a-9030-957a579b966d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:59.144603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c790e-e992-476a-9030-957a579b966d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:59.144869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c790e-e992-476a-9030-957a579b966d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:59.207973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c790e-e992-476a-9030-957a579b966d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:59.209431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c790e-e992-476a-9030-957a579b966d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:59.301048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 561/1144] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:45:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:45:59.306795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2df2f0-4fa2-4b79-b48f-fa50f133491d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:59.398421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2df2f0-4fa2-4b79-b48f-fa50f133491d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:59.431267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967d230-4b39-4837-899c-5231e792140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:59.432144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d230-4b39-4837-899c-5231e792140f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:59.432415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d230-4b39-4837-899c-5231e792140f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:59.432680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d230-4b39-4837-899c-5231e792140f None admin] PATH_INFO: `/v3/projects/a2cb7e4850c749148a0410101e6d112c` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:59.433832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967d230-4b39-4837-899c-5231e792140f None admin] RBAC: Authorizing `identity:get_project(project_id=a2cb7e4850c749148a0410101e6d112c)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:59.435248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967d230-4b39-4837-899c-5231e792140f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:59.436935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 584/1145] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:45:59 2022] GET /identity/v3/projects/a2cb7e4850c749148a0410101e6d112c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:45:59.443266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c790e-e992-476a-9030-957a579b966d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:45:59.537114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c790e-e992-476a-9030-957a579b966d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:45:59.573151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a3bc2-f0ad-448d-ba2d-66c421454d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:45:59.573723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3bc2-f0ad-448d-ba2d-66c421454d42 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:45:59.573999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3bc2-f0ad-448d-ba2d-66c421454d42 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:45:59.574267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3bc2-f0ad-448d-ba2d-66c421454d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:45:59.575089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a3bc2-f0ad-448d-ba2d-66c421454d42 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=a2cb7e4850c749148a0410101e6d112c, user.id=131c43e0790b446fb35db3d7a6772240) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:45:59.575423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a3bc2-f0ad-448d-ba2d-66c421454d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:45:59.576836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a3bc2-f0ad-448d-ba2d-66c421454d42 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:45:59.583042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 562/1146] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:45:59 2022] GET /identity/v3/role_assignments?user.id=131c43e0790b446fb35db3d7a6772240&scope.project.id=a2cb7e4850c749148a0410101e6d112c&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:01.785973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa68d-a6a1-486d-b0a4-152574f869dd None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:01.786581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa68d-a6a1-486d-b0a4-152574f869dd None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:01.786581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa68d-a6a1-486d-b0a4-152574f869dd None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:01.787893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 585/1147] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:01.793244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8433-381c-440a-a4e0-b1f2f6468564 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:01.793708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8433-381c-440a-a4e0-b1f2f6468564 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:01.793900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8433-381c-440a-a4e0-b1f2f6468564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:01.810689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-001b8433-381c-440a-a4e0-b1f2f6468564 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:01.811902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-001b8433-381c-440a-a4e0-b1f2f6468564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:01.873825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 563/1148] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:46:01.895680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa68d-a6a1-486d-b0a4-152574f869dd None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:01.992510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa68d-a6a1-486d-b0a4-152574f869dd None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:02.024121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3bb5-dc10-4f8b-8b17-fd62f7e9893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:02.024893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3bb5-dc10-4f8b-8b17-fd62f7e9893e None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:02.025170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3bb5-dc10-4f8b-8b17-fd62f7e9893e None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:02.025440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3bb5-dc10-4f8b-8b17-fd62f7e9893e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:02.035439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c3bb5-dc10-4f8b-8b17-fd62f7e9893e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-2b6c3bb5-dc10-4f8b-8b17-fd62f7e9893e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:46:02.042991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:46:02.044110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:46:02.045327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 586/1149] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:46:02.050638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b8433-381c-440a-a4e0-b1f2f6468564 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:02.142563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b8433-381c-440a-a4e0-b1f2f6468564 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:02.175256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:02.175928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:02.176205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:02.176474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:02.177201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:02.177501 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:02.178857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:02.186571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 564/1150] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:02.192458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3bb5-dc10-4f8b-8b17-fd62f7e9893e None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:02.288378 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3bb5-dc10-4f8b-8b17-fd62f7e9893e None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:02.319391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e873c9-f12c-46e5-9987-9fd8bbd933cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:02.320192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e873c9-f12c-46e5-9987-9fd8bbd933cc None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:02.320471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e873c9-f12c-46e5-9987-9fd8bbd933cc None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:02.320741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e873c9-f12c-46e5-9987-9fd8bbd933cc None admin] PATH_INFO: `/v3/users/131c43e0790b446fb35db3d7a6772240` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:02.321907 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e873c9-f12c-46e5-9987-9fd8bbd933cc None admin] RBAC: Authorizing `identity:get_user(user_id=131c43e0790b446fb35db3d7a6772240)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:02.323358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e873c9-f12c-46e5-9987-9fd8bbd933cc None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:02.324973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 587/1151] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:46:02 2022] GET /identity/v3/users/131c43e0790b446fb35db3d7a6772240 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:02.331088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:02.424802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee911-5f11-468b-8dbf-ab135598631d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:02.456286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2358b2-043d-4592-876e-5a707ac587bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:02.457141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2358b2-043d-4592-876e-5a707ac587bf None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:02.457413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2358b2-043d-4592-876e-5a707ac587bf None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:02.457680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2358b2-043d-4592-876e-5a707ac587bf None admin] PATH_INFO: `/v3/projects/a2cb7e4850c749148a0410101e6d112c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:02.458839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2358b2-043d-4592-876e-5a707ac587bf None admin] RBAC: Authorizing `identity:get_project(project_id=a2cb7e4850c749148a0410101e6d112c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:02.460271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2358b2-043d-4592-876e-5a707ac587bf None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:02.461951 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 565/1152] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:46:02 2022] GET /identity/v3/projects/a2cb7e4850c749148a0410101e6d112c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:02.467742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e873c9-f12c-46e5-9987-9fd8bbd933cc None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:02.561780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e873c9-f12c-46e5-9987-9fd8bbd933cc None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:02.592446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3a1f6-2fc3-4c10-a106-e513723023b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:02.593258 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3a1f6-2fc3-4c10-a106-e513723023b1 None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:02.593532 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3a1f6-2fc3-4c10-a106-e513723023b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:02.593797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3a1f6-2fc3-4c10-a106-e513723023b1 None admin] PATH_INFO: `/v3/projects/a2cb7e4850c749148a0410101e6d112c/users/131c43e0790b446fb35db3d7a6772240/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:02.596240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3a1f6-2fc3-4c10-a106-e513723023b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2cb7e4850c749148a0410101e6d112c, user_id=131c43e0790b446fb35db3d7a6772240, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:02.597662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3a1f6-2fc3-4c10-a106-e513723023b1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:02.610314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 588/1153] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:46:02 2022] PUT /identity/v3/projects/a2cb7e4850c749148a0410101e6d112c/users/131c43e0790b446fb35db3d7a6772240/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:46:04.803389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc44dd-1323-40d1-a66b-4d263b2901a7 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:04.803941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc44dd-1323-40d1-a66b-4d263b2901a7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:04.803941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc44dd-1323-40d1-a66b-4d263b2901a7 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:04.805288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 566/1154] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:04.810344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ead73-cfb4-4cc9-93a4-d4511b5cfe91 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:04.810739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ead73-cfb4-4cc9-93a4-d4511b5cfe91 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:04.810885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ead73-cfb4-4cc9-93a4-d4511b5cfe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:04.827241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-909ead73-cfb4-4cc9-93a4-d4511b5cfe91 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:04.828433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-909ead73-cfb4-4cc9-93a4-d4511b5cfe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:04.892809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 589/1155] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:46:04.916172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc44dd-1323-40d1-a66b-4d263b2901a7 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:05.012708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc44dd-1323-40d1-a66b-4d263b2901a7 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:05.043976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678cf05-d7f9-48b4-9ae9-3ff9f1c4bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:05.044752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678cf05-d7f9-48b4-9ae9-3ff9f1c4bf2a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:05.045028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678cf05-d7f9-48b4-9ae9-3ff9f1c4bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:05.045297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678cf05-d7f9-48b4-9ae9-3ff9f1c4bf2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:05.055869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678cf05-d7f9-48b4-9ae9-3ff9f1c4bf2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-3678cf05-d7f9-48b4-9ae9-3ff9f1c4bf2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:46:05.063452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:46:05.064535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:46:05.065957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 567/1156] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:46:05.070741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ead73-cfb4-4cc9-93a4-d4511b5cfe91 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:05.161826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ead73-cfb4-4cc9-93a4-d4511b5cfe91 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:05.194535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:05.195186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:05.195498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:05.195765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:05.196500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:05.196798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:05.198169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:05.206595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 590/1157] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:05.212427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678cf05-d7f9-48b4-9ae9-3ff9f1c4bf2a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:05.306256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678cf05-d7f9-48b4-9ae9-3ff9f1c4bf2a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:05.338120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b974e3-643c-49ce-9d08-a47963abfd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:05.338962 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b974e3-643c-49ce-9d08-a47963abfd95 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:05.339239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b974e3-643c-49ce-9d08-a47963abfd95 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:05.339545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b974e3-643c-49ce-9d08-a47963abfd95 None admin] PATH_INFO: `/v3/users/131c43e0790b446fb35db3d7a6772240` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:05.340706 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b974e3-643c-49ce-9d08-a47963abfd95 None admin] RBAC: Authorizing `identity:get_user(user_id=131c43e0790b446fb35db3d7a6772240)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:05.342120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b974e3-643c-49ce-9d08-a47963abfd95 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:05.343776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 568/1158] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:46:05 2022] GET /identity/v3/users/131c43e0790b446fb35db3d7a6772240 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:05.349945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:05.442448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b9433-bf7f-4632-b474-522006414aa3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:05.473945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b6c5-0f4d-485a-9a78-a7810ff4c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:05.474567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b6c5-0f4d-485a-9a78-a7810ff4c0bb None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:05.474842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b6c5-0f4d-485a-9a78-a7810ff4c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:05.475109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b6c5-0f4d-485a-9a78-a7810ff4c0bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:05.537147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b6c5-0f4d-485a-9a78-a7810ff4c0bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:05.538580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b6c5-0f4d-485a-9a78-a7810ff4c0bb None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:05.629509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 591/1159] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:46:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:46:05.635429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b974e3-643c-49ce-9d08-a47963abfd95 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:05.730208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b974e3-643c-49ce-9d08-a47963abfd95 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:05.761981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208493-6dc7-4b7f-94d6-a84a3c83d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:05.762810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208493-6dc7-4b7f-94d6-a84a3c83d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:05.763087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208493-6dc7-4b7f-94d6-a84a3c83d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:05.763381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208493-6dc7-4b7f-94d6-a84a3c83d1e6 None admin] PATH_INFO: `/v3/projects/a2cb7e4850c749148a0410101e6d112c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:05.764539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208493-6dc7-4b7f-94d6-a84a3c83d1e6 None admin] RBAC: Authorizing `identity:get_project(project_id=a2cb7e4850c749148a0410101e6d112c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:05.765946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208493-6dc7-4b7f-94d6-a84a3c83d1e6 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:05.768185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 569/1160] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:46:05 2022] GET /identity/v3/projects/a2cb7e4850c749148a0410101e6d112c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:05.774106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b6c5-0f4d-485a-9a78-a7810ff4c0bb None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:05.865454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b6c5-0f4d-485a-9a78-a7810ff4c0bb None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:05.897218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d5778-3d75-4350-9383-63a4542a07ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:05.897790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5778-3d75-4350-9383-63a4542a07ff None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:05.898064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5778-3d75-4350-9383-63a4542a07ff None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:05.898330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5778-3d75-4350-9383-63a4542a07ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:05.899133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5778-3d75-4350-9383-63a4542a07ff None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=a2cb7e4850c749148a0410101e6d112c, user.id=131c43e0790b446fb35db3d7a6772240) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:05.899461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5778-3d75-4350-9383-63a4542a07ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:05.900863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5778-3d75-4350-9383-63a4542a07ff None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:05.906319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 592/1161] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:46:05 2022] GET /identity/v3/role_assignments?user.id=131c43e0790b446fb35db3d7a6772240&scope.project.id=a2cb7e4850c749148a0410101e6d112c&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:08.123040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c0e2-e96d-40ff-a1de-b92f032a22af None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:08.123634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c0e2-e96d-40ff-a1de-b92f032a22af None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:08.123634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c0e2-e96d-40ff-a1de-b92f032a22af None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:08.124992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 570/1162] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:08.130111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9c1d-26cf-4b92-9d5c-e2ea5ea73171 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:08.130531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9c1d-26cf-4b92-9d5c-e2ea5ea73171 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:08.130655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9c1d-26cf-4b92-9d5c-e2ea5ea73171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:08.146750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0a5d9c1d-26cf-4b92-9d5c-e2ea5ea73171 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:08.147938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0a5d9c1d-26cf-4b92-9d5c-e2ea5ea73171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:08.210551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 593/1163] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:46:08.232926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195c0e2-e96d-40ff-a1de-b92f032a22af None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:08.327865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195c0e2-e96d-40ff-a1de-b92f032a22af None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:08.360194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f84d9-431e-4bbf-b7cb-cece9652a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:08.360849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f84d9-431e-4bbf-b7cb-cece9652a69f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:08.361130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f84d9-431e-4bbf-b7cb-cece9652a69f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:08.361404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f84d9-431e-4bbf-b7cb-cece9652a69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:08.424651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f84d9-431e-4bbf-b7cb-cece9652a69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:08.426112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f84d9-431e-4bbf-b7cb-cece9652a69f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:08.517723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 571/1164] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:46:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:46:08.523530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d9c1d-26cf-4b92-9d5c-e2ea5ea73171 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:08.614588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d9c1d-26cf-4b92-9d5c-e2ea5ea73171 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:08.646305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b304b-d4e0-461d-9bbd-c88323ab90af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:08.647082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b304b-d4e0-461d-9bbd-c88323ab90af None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:08.647381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b304b-d4e0-461d-9bbd-c88323ab90af None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:08.647648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b304b-d4e0-461d-9bbd-c88323ab90af None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:08.653945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b304b-d4e0-461d-9bbd-c88323ab90af None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:08.655399 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b304b-d4e0-461d-9bbd-c88323ab90af None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-985b304b-d4e0-461d-9bbd-c88323ab90af None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:46:08.668939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:46:08.670114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:46:08.671016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 594/1165] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:46:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:46:08.676045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f84d9-431e-4bbf-b7cb-cece9652a69f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:08.774600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f84d9-431e-4bbf-b7cb-cece9652a69f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:08.805856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936be5e-caa7-4a94-9873-e99071402418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:08.806502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936be5e-caa7-4a94-9873-e99071402418 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:08.806782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936be5e-caa7-4a94-9873-e99071402418 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:08.807055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936be5e-caa7-4a94-9873-e99071402418 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:08.807820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936be5e-caa7-4a94-9873-e99071402418 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:08.808126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936be5e-caa7-4a94-9873-e99071402418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:08.809472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936be5e-caa7-4a94-9873-e99071402418 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:08.817130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 572/1166] 10.222.0.93 () {56 vars in 1115 bytes} [Wed May 11 18:46:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:11.008442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5dd2-0de5-4095-838a-d62b70d580ca None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:11.008967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5dd2-0de5-4095-838a-d62b70d580ca None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:11.008967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5dd2-0de5-4095-838a-d62b70d580ca None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:11.010356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 595/1167] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:11.015668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab511a-c2fd-4185-8ef8-ee1d70ab300d None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:11.016098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab511a-c2fd-4185-8ef8-ee1d70ab300d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:11.016215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab511a-c2fd-4185-8ef8-ee1d70ab300d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:11.032894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-85ab511a-c2fd-4185-8ef8-ee1d70ab300d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:11.034078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-85ab511a-c2fd-4185-8ef8-ee1d70ab300d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:11.095832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 573/1168] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:46:11.118267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e5dd2-0de5-4095-838a-d62b70d580ca None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:11.217541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e5dd2-0de5-4095-838a-d62b70d580ca None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:11.250051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51afd-07ee-4546-a5a0-30d2f0203865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:11.250697 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51afd-07ee-4546-a5a0-30d2f0203865 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:11.251028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51afd-07ee-4546-a5a0-30d2f0203865 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:11.251837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51afd-07ee-4546-a5a0-30d2f0203865 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:11.252567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e51afd-07ee-4546-a5a0-30d2f0203865 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:11.253929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e51afd-07ee-4546-a5a0-30d2f0203865 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:11.267979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 596/1169] 10.222.0.93 () {60 vars in 1138 bytes} [Wed May 11 18:46:11 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:46:13.475657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bbe59-9022-403c-8ce0-74b26af780f4 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:13.476217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bbe59-9022-403c-8ce0-74b26af780f4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:13.476217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bbe59-9022-403c-8ce0-74b26af780f4 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:13.477486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 574/1170] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:13.482743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e913ee-f1f1-492d-b54e-5a0a83fa8436 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:13.483160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e913ee-f1f1-492d-b54e-5a0a83fa8436 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:13.483324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e913ee-f1f1-492d-b54e-5a0a83fa8436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:13.499492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-72e913ee-f1f1-492d-b54e-5a0a83fa8436 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:13.500674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-72e913ee-f1f1-492d-b54e-5a0a83fa8436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:13.563570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 597/1171] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:46:13.587397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bbe59-9022-403c-8ce0-74b26af780f4 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:13.682226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bbe59-9022-403c-8ce0-74b26af780f4 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:13.713898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc929be2-e3e4-4b25-a44b-506d2247f8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:13.714772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc929be2-e3e4-4b25-a44b-506d2247f8c9 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:13.715049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc929be2-e3e4-4b25-a44b-506d2247f8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:13.715338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc929be2-e3e4-4b25-a44b-506d2247f8c9 None admin] PATH_INFO: `/v3/domains/57fa7d7fdcf04b5fb457dcf13912dc8c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:13.725790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc929be2-e3e4-4b25-a44b-506d2247f8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=57fa7d7fdcf04b5fb457dcf13912dc8c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:13.727157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc929be2-e3e4-4b25-a44b-506d2247f8c9 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:13.728794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 575/1172] 10.222.0.93 () {56 vars in 1183 bytes} [Wed May 11 18:46:13 2022] GET /identity/v3/domains/57fa7d7fdcf04b5fb457dcf13912dc8c => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:13.734627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e913ee-f1f1-492d-b54e-5a0a83fa8436 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:13.828371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e913ee-f1f1-492d-b54e-5a0a83fa8436 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:13.860066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629d77e-b9eb-4820-94ec-40441d5f823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:13.860734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629d77e-b9eb-4820-94ec-40441d5f823f None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:13.861011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629d77e-b9eb-4820-94ec-40441d5f823f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:13.861278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629d77e-b9eb-4820-94ec-40441d5f823f None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:13.861967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629d77e-b9eb-4820-94ec-40441d5f823f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:13.863432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629d77e-b9eb-4820-94ec-40441d5f823f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:13.887703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 598/1173] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:46:13 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:46:16.100019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24b8e-982d-4ea4-ac26-19fa7c2e40fa None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:16.100575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24b8e-982d-4ea4-ac26-19fa7c2e40fa None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:16.100575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24b8e-982d-4ea4-ac26-19fa7c2e40fa None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:16.102275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 576/1174] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:16.108871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69da45-d949-4a9d-b716-54117d474be4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:16.109281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69da45-d949-4a9d-b716-54117d474be4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:16.109501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69da45-d949-4a9d-b716-54117d474be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:16.125545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-1b69da45-d949-4a9d-b716-54117d474be4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:16.127219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1b69da45-d949-4a9d-b716-54117d474be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:16.187899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 599/1175] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:46:16.213595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e24b8e-982d-4ea4-ac26-19fa7c2e40fa None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:16.309909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e24b8e-982d-4ea4-ac26-19fa7c2e40fa None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:16.340604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2e2f1-121e-4350-b744-702e6cee9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:16.341450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e2f1-121e-4350-b744-702e6cee9583 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:16.341723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e2f1-121e-4350-b744-702e6cee9583 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:16.341987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e2f1-121e-4350-b744-702e6cee9583 None admin] PATH_INFO: `/v3/domains/57fa7d7fdcf04b5fb457dcf13912dc8c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:16.343137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2e2f1-121e-4350-b744-702e6cee9583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=57fa7d7fdcf04b5fb457dcf13912dc8c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:16.345072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2e2f1-121e-4350-b744-702e6cee9583 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:16.346641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 577/1176] 10.222.0.93 () {56 vars in 1183 bytes} [Wed May 11 18:46:16 2022] GET /identity/v3/domains/57fa7d7fdcf04b5fb457dcf13912dc8c => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:16.352402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69da45-d949-4a9d-b716-54117d474be4 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:16.444976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69da45-d949-4a9d-b716-54117d474be4 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:16.476690 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ecad7-c36c-490c-9e52-8eb6ee268872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:16.477330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ecad7-c36c-490c-9e52-8eb6ee268872 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:16.477605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ecad7-c36c-490c-9e52-8eb6ee268872 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:16.477874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ecad7-c36c-490c-9e52-8eb6ee268872 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:16.478566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ecad7-c36c-490c-9e52-8eb6ee268872 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:16.480007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ecad7-c36c-490c-9e52-8eb6ee268872 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:16.498417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 600/1177] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:46:16 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:46:18.754874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988a90-e513-4692-938c-d0fc65acdaed None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:18.755458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988a90-e513-4692-938c-d0fc65acdaed None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:18.755458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988a90-e513-4692-938c-d0fc65acdaed None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:18.756808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 578/1178] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:18.761934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f572-2bca-4334-8c2d-fd121cb350b8 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:18.762375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f572-2bca-4334-8c2d-fd121cb350b8 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:18.762475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f572-2bca-4334-8c2d-fd121cb350b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:18.778836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d7e6f572-2bca-4334-8c2d-fd121cb350b8 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:18.780063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d7e6f572-2bca-4334-8c2d-fd121cb350b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:18.842151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 601/1179] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:46:18.865230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b988a90-e513-4692-938c-d0fc65acdaed None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:18.962375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b988a90-e513-4692-938c-d0fc65acdaed None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:18.993922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4867a-8e23-40fc-b3ea-02ffe5a63ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:18.994696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4867a-8e23-40fc-b3ea-02ffe5a63ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:18.994973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4867a-8e23-40fc-b3ea-02ffe5a63ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:18.995242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4867a-8e23-40fc-b3ea-02ffe5a63ea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:19.005981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4867a-8e23-40fc-b3ea-02ffe5a63ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-e5d4867a-8e23-40fc-b3ea-02ffe5a63ea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:46:19.013373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:46:19.014575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:46:19.015701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 579/1180] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:46:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:46:19.020493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f572-2bca-4334-8c2d-fd121cb350b8 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:19.116978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f572-2bca-4334-8c2d-fd121cb350b8 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:19.148122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:19.148770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:19.149048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:19.149318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:19.150046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:19.150346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:19.151743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:19.159867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 602/1181] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:19.165656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4867a-8e23-40fc-b3ea-02ffe5a63ea8 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:19.260968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4867a-8e23-40fc-b3ea-02ffe5a63ea8 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:19.296218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf515-e84c-4c8a-a433-4e89c56c6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:19.297078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf515-e84c-4c8a-a433-4e89c56c6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:19.297359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf515-e84c-4c8a-a433-4e89c56c6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:19.298246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf515-e84c-4c8a-a433-4e89c56c6ea7 None admin] PATH_INFO: `/v3/users/6652d094e41045469392bfbdd3113924` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:19.310889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bf515-e84c-4c8a-a433-4e89c56c6ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=6652d094e41045469392bfbdd3113924)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:19.312370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bf515-e84c-4c8a-a433-4e89c56c6ea7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:19.314051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 580/1182] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:46:19 2022] GET /identity/v3/users/6652d094e41045469392bfbdd3113924 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:19.320251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:19.414155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e0d48-6ce4-4d6f-82b0-4dbf1b0cd68a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:19.448152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f8191-94b0-44f4-9a63-593dbbf827cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:19.448789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f8191-94b0-44f4-9a63-593dbbf827cc None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:19.449066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f8191-94b0-44f4-9a63-593dbbf827cc None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:19.449334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f8191-94b0-44f4-9a63-593dbbf827cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:19.512093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f8191-94b0-44f4-9a63-593dbbf827cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:19.513486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f8191-94b0-44f4-9a63-593dbbf827cc None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:19.605577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 603/1183] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:46:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:46:19.611491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf515-e84c-4c8a-a433-4e89c56c6ea7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:19.703196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf515-e84c-4c8a-a433-4e89c56c6ea7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:19.735783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd307fbd-f2a2-4525-8968-7b817045fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:19.736640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307fbd-f2a2-4525-8968-7b817045fa68 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:19.736919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307fbd-f2a2-4525-8968-7b817045fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:19.737190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307fbd-f2a2-4525-8968-7b817045fa68 None admin] PATH_INFO: `/v3/projects/ba1771efcbb44c2e9d2aa41b66090b56` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:19.738346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd307fbd-f2a2-4525-8968-7b817045fa68 None admin] RBAC: Authorizing `identity:get_project(project_id=ba1771efcbb44c2e9d2aa41b66090b56)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:19.739828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd307fbd-f2a2-4525-8968-7b817045fa68 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:19.741523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 581/1184] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:46:19 2022] GET /identity/v3/projects/ba1771efcbb44c2e9d2aa41b66090b56 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:46:19.747505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f8191-94b0-44f4-9a63-593dbbf827cc None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:19.841777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f8191-94b0-44f4-9a63-593dbbf827cc None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:19.873478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40452ade-7ac7-4349-b5aa-2c8973746a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:19.874110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452ade-7ac7-4349-b5aa-2c8973746a5d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:19.874395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452ade-7ac7-4349-b5aa-2c8973746a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:19.874667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40452ade-7ac7-4349-b5aa-2c8973746a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:19.875501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40452ade-7ac7-4349-b5aa-2c8973746a5d None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=ba1771efcbb44c2e9d2aa41b66090b56, user.id=6652d094e41045469392bfbdd3113924) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:19.876312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40452ade-7ac7-4349-b5aa-2c8973746a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:19.877723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40452ade-7ac7-4349-b5aa-2c8973746a5d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:19.882922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 604/1185] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:46:19 2022] GET /identity/v3/role_assignments?user.id=6652d094e41045469392bfbdd3113924&scope.project.id=ba1771efcbb44c2e9d2aa41b66090b56&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:22.063049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb318a2-de02-4ce0-9adb-db4984ea7c7b None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:22.063669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb318a2-de02-4ce0-9adb-db4984ea7c7b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:22.063669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb318a2-de02-4ce0-9adb-db4984ea7c7b None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:22.065236 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 582/1186] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:22.070412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f96b74-895e-4f01-a9d3-a388e0d295d7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:22.070816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f96b74-895e-4f01-a9d3-a388e0d295d7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:22.070957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f96b74-895e-4f01-a9d3-a388e0d295d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:22.087049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-03f96b74-895e-4f01-a9d3-a388e0d295d7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:22.088248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-03f96b74-895e-4f01-a9d3-a388e0d295d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:22.149821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 605/1187] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:46:22.172176 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb318a2-de02-4ce0-9adb-db4984ea7c7b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:22.268155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb318a2-de02-4ce0-9adb-db4984ea7c7b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:22.300354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa9958-40b0-40b9-b761-85cf5dde1edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:22.301131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9958-40b0-40b9-b761-85cf5dde1edc None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:22.301412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9958-40b0-40b9-b761-85cf5dde1edc None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:22.301682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9958-40b0-40b9-b761-85cf5dde1edc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:22.311232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa9958-40b0-40b9-b761-85cf5dde1edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-84aa9958-40b0-40b9-b761-85cf5dde1edc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:46:22.319164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:46:22.320323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:46:22.321160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 583/1188] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:46:22.326273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f96b74-895e-4f01-a9d3-a388e0d295d7 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:22.420402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f96b74-895e-4f01-a9d3-a388e0d295d7 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:22.452098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:22.452753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:22.453028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:22.453295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:22.454521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:22.454821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:22.456224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:22.463776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 606/1189] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:22.470303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa9958-40b0-40b9-b761-85cf5dde1edc None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:22.563414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa9958-40b0-40b9-b761-85cf5dde1edc None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:22.595676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba9360-e8ad-4212-96e4-0b088f35b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:22.596476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9360-e8ad-4212-96e4-0b088f35b03c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:22.596755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9360-e8ad-4212-96e4-0b088f35b03c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:22.597027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9360-e8ad-4212-96e4-0b088f35b03c None admin] PATH_INFO: `/v3/users/6652d094e41045469392bfbdd3113924` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:22.598197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba9360-e8ad-4212-96e4-0b088f35b03c None admin] RBAC: Authorizing `identity:get_user(user_id=6652d094e41045469392bfbdd3113924)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:22.599633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba9360-e8ad-4212-96e4-0b088f35b03c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:22.601225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 584/1190] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:46:22 2022] GET /identity/v3/users/6652d094e41045469392bfbdd3113924 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:22.606724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:22.698762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb506c-efb8-421c-8553-8249aebc7375 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:22.732295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d2671-e142-403d-842c-f29e549d8b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:22.733147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d2671-e142-403d-842c-f29e549d8b6c None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:22.733421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d2671-e142-403d-842c-f29e549d8b6c None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:22.733691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d2671-e142-403d-842c-f29e549d8b6c None admin] PATH_INFO: `/v3/projects/ba1771efcbb44c2e9d2aa41b66090b56` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:22.734848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d2671-e142-403d-842c-f29e549d8b6c None admin] RBAC: Authorizing `identity:get_project(project_id=ba1771efcbb44c2e9d2aa41b66090b56)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:22.736332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d2671-e142-403d-842c-f29e549d8b6c None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:22.738014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 607/1191] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:46:22 2022] GET /identity/v3/projects/ba1771efcbb44c2e9d2aa41b66090b56 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:22.743896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba9360-e8ad-4212-96e4-0b088f35b03c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:22.837943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba9360-e8ad-4212-96e4-0b088f35b03c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:22.868284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef9de0-4bf2-4962-b73a-97068fe381ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:22.869093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef9de0-4bf2-4962-b73a-97068fe381ee None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:22.869367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef9de0-4bf2-4962-b73a-97068fe381ee None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:22.869633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef9de0-4bf2-4962-b73a-97068fe381ee None admin] PATH_INFO: `/v3/projects/ba1771efcbb44c2e9d2aa41b66090b56/users/6652d094e41045469392bfbdd3113924/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:22.871695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef9de0-4bf2-4962-b73a-97068fe381ee None admin] RBAC: Authorizing `identity:create_grant(project_id=ba1771efcbb44c2e9d2aa41b66090b56, user_id=6652d094e41045469392bfbdd3113924, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:22.873120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef9de0-4bf2-4962-b73a-97068fe381ee None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:22.885566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 585/1192] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:46:22 2022] PUT /identity/v3/projects/ba1771efcbb44c2e9d2aa41b66090b56/users/6652d094e41045469392bfbdd3113924/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:46:25.080871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734cbd7-0e14-4d62-bc09-15ba8f20c7fe None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:25.081428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734cbd7-0e14-4d62-bc09-15ba8f20c7fe None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:25.081428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734cbd7-0e14-4d62-bc09-15ba8f20c7fe None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:25.082759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 608/1193] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:46:25.087991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf681-b5ad-4071-8da1-aa077ca5d452 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:25.088416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf681-b5ad-4071-8da1-aa077ca5d452 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:25.088547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf681-b5ad-4071-8da1-aa077ca5d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:25.105269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-73cbf681-b5ad-4071-8da1-aa077ca5d452 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:46:25.106478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-73cbf681-b5ad-4071-8da1-aa077ca5d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:46:25.168376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 586/1194] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:46:25.191837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734cbd7-0e14-4d62-bc09-15ba8f20c7fe None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:25.285286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734cbd7-0e14-4d62-bc09-15ba8f20c7fe None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:25.316891 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a44e7-aab5-418e-af30-f57c8b35e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:25.317667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a44e7-aab5-418e-af30-f57c8b35e7bf None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:25.317943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a44e7-aab5-418e-af30-f57c8b35e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:25.318211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a44e7-aab5-418e-af30-f57c8b35e7bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:25.328302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a44e7-aab5-418e-af30-f57c8b35e7bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-de0a44e7-aab5-418e-af30-f57c8b35e7bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:46:25.335913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:46:25.336988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:46:25.338010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 609/1195] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:46:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:46:25.343211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbf681-b5ad-4071-8da1-aa077ca5d452 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:25.440724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbf681-b5ad-4071-8da1-aa077ca5d452 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:25.473022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:25.473679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:25.473952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:25.474255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:25.474992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:25.475288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:25.476826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:25.484603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 587/1196] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:46:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:25.490482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a44e7-aab5-418e-af30-f57c8b35e7bf None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:25.584101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a44e7-aab5-418e-af30-f57c8b35e7bf None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:25.615418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc75c7-9a5b-4411-b2c2-08d8f2a7c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:25.616210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc75c7-9a5b-4411-b2c2-08d8f2a7c8dd None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:25.616489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc75c7-9a5b-4411-b2c2-08d8f2a7c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:25.616757 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc75c7-9a5b-4411-b2c2-08d8f2a7c8dd None admin] PATH_INFO: `/v3/users/6652d094e41045469392bfbdd3113924` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:25.617932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc75c7-9a5b-4411-b2c2-08d8f2a7c8dd None admin] RBAC: Authorizing `identity:get_user(user_id=6652d094e41045469392bfbdd3113924)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:25.619380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc75c7-9a5b-4411-b2c2-08d8f2a7c8dd None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:25.620969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 610/1197] 10.222.0.93 () {56 vars in 1177 bytes} [Wed May 11 18:46:25 2022] GET /identity/v3/users/6652d094e41045469392bfbdd3113924 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:25.626592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:25.718686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a015d-eb84-46c8-9872-a3725d161dea None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:25.749602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923afdb0-6057-46b2-8e1d-9036afa8aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:25.750224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923afdb0-6057-46b2-8e1d-9036afa8aabc None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:25.750523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923afdb0-6057-46b2-8e1d-9036afa8aabc None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:25.750790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923afdb0-6057-46b2-8e1d-9036afa8aabc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:25.812548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923afdb0-6057-46b2-8e1d-9036afa8aabc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:25.814796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923afdb0-6057-46b2-8e1d-9036afa8aabc None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:25.905507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 588/1198] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:46:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:46:25.911278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc75c7-9a5b-4411-b2c2-08d8f2a7c8dd None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:26.004916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc75c7-9a5b-4411-b2c2-08d8f2a7c8dd None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:26.036241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b81953-59d7-4554-b7b3-42998e79f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:26.037080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81953-59d7-4554-b7b3-42998e79f9ee None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:26.037359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81953-59d7-4554-b7b3-42998e79f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:26.037630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81953-59d7-4554-b7b3-42998e79f9ee None admin] PATH_INFO: `/v3/projects/ba1771efcbb44c2e9d2aa41b66090b56` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:26.038785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b81953-59d7-4554-b7b3-42998e79f9ee None admin] RBAC: Authorizing `identity:get_project(project_id=ba1771efcbb44c2e9d2aa41b66090b56)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:26.040242 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b81953-59d7-4554-b7b3-42998e79f9ee None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:26.041938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 611/1199] 10.222.0.93 () {56 vars in 1186 bytes} [Wed May 11 18:46:25 2022] GET /identity/v3/projects/ba1771efcbb44c2e9d2aa41b66090b56 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:46:26.047906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923afdb0-6057-46b2-8e1d-9036afa8aabc None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:46:26.140955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923afdb0-6057-46b2-8e1d-9036afa8aabc None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:46:26.173259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c77cb5-1675-4216-827a-4d196cd5b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:46:26.173895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c77cb5-1675-4216-827a-4d196cd5b269 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:46:26.174174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c77cb5-1675-4216-827a-4d196cd5b269 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:46:26.174446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c77cb5-1675-4216-827a-4d196cd5b269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:46:26.175263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c77cb5-1675-4216-827a-4d196cd5b269 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=ba1771efcbb44c2e9d2aa41b66090b56, user.id=6652d094e41045469392bfbdd3113924) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:46:26.175600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c77cb5-1675-4216-827a-4d196cd5b269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:46:26.177017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c77cb5-1675-4216-827a-4d196cd5b269 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:46:26.182584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 589/1200] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:46:26 2022] GET /identity/v3/role_assignments?user.id=6652d094e41045469392bfbdd3113924&scope.project.id=ba1771efcbb44c2e9d2aa41b66090b56&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:26.759916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e85d9-1839-49ba-b8d8-fbd628ba4265 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:26.760531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e85d9-1839-49ba-b8d8-fbd628ba4265 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:26.760633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e85d9-1839-49ba-b8d8-fbd628ba4265 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:26.762007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 612/1201] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:26.769499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace20bbd-aa61-420a-af00-5112fd25a914 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:26.769499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace20bbd-aa61-420a-af00-5112fd25a914 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:26.769499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace20bbd-aa61-420a-af00-5112fd25a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:26.792299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ace20bbd-aa61-420a-af00-5112fd25a914 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:26.793554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ace20bbd-aa61-420a-af00-5112fd25a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:26.886228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 590/1202] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:47:26.912377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e85d9-1839-49ba-b8d8-fbd628ba4265 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:27.047103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e85d9-1839-49ba-b8d8-fbd628ba4265 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:27.089692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:27.090618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:27.090949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:27.091349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:27.110234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:27.112926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:27.143149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:27.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:27.145352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:27.145352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:27.145352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:27.145352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:27.145981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 613/1203] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:27.152087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace20bbd-aa61-420a-af00-5112fd25a914 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:27.280566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace20bbd-aa61-420a-af00-5112fd25a914 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:27.322077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f96ec-6b5f-4033-b5f2-2ec8a7e13e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:27.322713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f96ec-6b5f-4033-b5f2-2ec8a7e13e11 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:27.323050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f96ec-6b5f-4033-b5f2-2ec8a7e13e11 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:27.323370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f96ec-6b5f-4033-b5f2-2ec8a7e13e11 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:27.324245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f96ec-6b5f-4033-b5f2-2ec8a7e13e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:27.324624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f96ec-6b5f-4033-b5f2-2ec8a7e13e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:27.326159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f96ec-6b5f-4033-b5f2-2ec8a7e13e11 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:27.340110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 591/1204] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:27.346589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:27.461017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f854-8cb5-45b8-994e-d57957b0febe None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:27.504044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959652b-8e56-42df-9a06-8d0ab353ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:27.504874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959652b-8e56-42df-9a06-8d0ab353ba10 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:27.505105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959652b-8e56-42df-9a06-8d0ab353ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:27.505308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959652b-8e56-42df-9a06-8d0ab353ba10 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:27.505935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959652b-8e56-42df-9a06-8d0ab353ba10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:27.507404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959652b-8e56-42df-9a06-8d0ab353ba10 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:27.535992 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 614/1205] 10.222.0.93 () {60 vars in 1132 bytes} [Wed May 11 18:47:27 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:47:30.110711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101b43e-d569-4551-9f91-ca78c8114129 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:30.111273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101b43e-d569-4551-9f91-ca78c8114129 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:30.111273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101b43e-d569-4551-9f91-ca78c8114129 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:30.112791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 592/1206] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:30.118345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396dc7-08fa-44fa-8313-00f6805d467d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:30.118795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396dc7-08fa-44fa-8313-00f6805d467d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:30.118883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396dc7-08fa-44fa-8313-00f6805d467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:30.136492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c4396dc7-08fa-44fa-8313-00f6805d467d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:30.137760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c4396dc7-08fa-44fa-8313-00f6805d467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:30.219367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 615/1207] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:47:30.240933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101b43e-d569-4551-9f91-ca78c8114129 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:30.363130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101b43e-d569-4551-9f91-ca78c8114129 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:30.402841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18268-64e4-4b8d-9bf4-50ce4f8df85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:30.403754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18268-64e4-4b8d-9bf4-50ce4f8df85d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:30.404167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18268-64e4-4b8d-9bf4-50ce4f8df85d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:30.404444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18268-64e4-4b8d-9bf4-50ce4f8df85d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:30.416254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee18268-64e4-4b8d-9bf4-50ce4f8df85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-9ee18268-64e4-4b8d-9bf4-50ce4f8df85d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:47:30.424715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:30.426727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:47:30.427823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:30.431253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 593/1208] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:47:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:30.432499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4396dc7-08fa-44fa-8313-00f6805d467d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:30.540436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4396dc7-08fa-44fa-8313-00f6805d467d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:30.576783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:30.577628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:30.578648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:30.579109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:30.580003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:30.580371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:30.581850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:30.590881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 616/1209] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:47:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:30.597281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18268-64e4-4b8d-9bf4-50ce4f8df85d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:30.708315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18268-64e4-4b8d-9bf4-50ce4f8df85d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:30.746901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:30.747803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:30.748914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:30.748914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:30.759808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:30.761259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:30.779645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:30.780589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:30.781680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:30.781680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:30.781680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:30.781680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:30.781680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 594/1210] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:47:30.788095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:30.909105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dba24-54e1-4266-91a5-9ec17df563cf None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:30.946419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:30.947424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:30.947898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:30.948459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:30.949457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:30.949951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:30.951652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:30.964448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 617/1211] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:30.970201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:31.093016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d73c99-ffdd-4d03-8e9b-e71324a9a3ff None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:31.134240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:31.135101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:31.135447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:31.135698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:31.143678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:31.145182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:47:31.162246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:31.164239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:31.165427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:31.168528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 595/1212] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:31.169511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:31.285189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953949-62d0-4d2c-b82d-71e90f9dd3e0 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:31.323051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:31.323785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:31.324113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:31.324523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:31.325179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:31.325488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:31.327019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:31.348010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 618/1213] 10.222.0.93 () {56 vars in 1143 bytes} [Wed May 11 18:47:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:31.353448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:31.458880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cd36c-e2e1-4dee-8c5c-3ee215aec74f None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:31.494812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb5451-efec-475c-86bf-d5e2f761cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:31.495521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb5451-efec-475c-86bf-d5e2f761cfbc None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:31.495798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb5451-efec-475c-86bf-d5e2f761cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:31.496066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb5451-efec-475c-86bf-d5e2f761cfbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:31.572817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb5451-efec-475c-86bf-d5e2f761cfbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:31.573145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb5451-efec-475c-86bf-d5e2f761cfbc None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:31.681216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 596/1214] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:47:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 18:47:31.686882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:31.792845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9cdb-5dfb-42a9-b6c3-586611c6e5b1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:31.832544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:31.833346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:31.833630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:31.833903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:31.845682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:31.847248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:31.865040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:31.866108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:31.867166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:31.867166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:31.867166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:31.867166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:31.869054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 619/1215] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:31.874585 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb5451-efec-475c-86bf-d5e2f761cfbc None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:31.990946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb5451-efec-475c-86bf-d5e2f761cfbc None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:32.031708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:32.032375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:32.032656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:32.032925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:32.033655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:32.033961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:32.035346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:32.047594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 597/1216] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:32.053391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:32.166430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a74eb-f38b-4cc6-86cf-307a1120f83d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:32.208132 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:32.208601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:32.208814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:32.209086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:32.217087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:32.219358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:47:32.234806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:32.235834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:32.236712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:47:32.236712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:47:32.236712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:47:32.236712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:47:32.236712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:47:32.236712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:47:32.236712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:32.236712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:32.239361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 620/1217] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:32.247577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:32.368231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e59c-b79f-421b-8ff7-a391dff9623b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:32.408344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b52d-a6a5-4a2e-8ec9-61027948cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:32.409396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b52d-a6a5-4a2e-8ec9-61027948cdbe None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:32.409920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b52d-a6a5-4a2e-8ec9-61027948cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:32.410360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b52d-a6a5-4a2e-8ec9-61027948cdbe None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:32.411515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b52d-a6a5-4a2e-8ec9-61027948cdbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:32.412013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b52d-a6a5-4a2e-8ec9-61027948cdbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:32.413787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b52d-a6a5-4a2e-8ec9-61027948cdbe None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:32.428184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 598/1218] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:32.435254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:32.556987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802972d-a455-4c85-9cf1-3c51c3c65f85 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:32.593658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8925-89cc-4fd1-b7cd-438a42777159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:32.594316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8925-89cc-4fd1-b7cd-438a42777159 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:32.594604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8925-89cc-4fd1-b7cd-438a42777159 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:32.594866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8925-89cc-4fd1-b7cd-438a42777159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:32.595720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8925-89cc-4fd1-b7cd-438a42777159 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=911d21a666844fc399286e24c2892184) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:32.596027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8925-89cc-4fd1-b7cd-438a42777159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:32.597453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8925-89cc-4fd1-b7cd-438a42777159 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:32.603935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 621/1219] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:47:32 2022] GET /identity/v3/role_assignments?user.id=911d21a666844fc399286e24c2892184&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:34.849409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf3e51-c7e5-42ff-95c4-fc563b7ee552 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:34.849978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf3e51-c7e5-42ff-95c4-fc563b7ee552 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:34.849978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf3e51-c7e5-42ff-95c4-fc563b7ee552 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:34.851638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 599/1220] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:34.856885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e901566-d86e-47c5-bcc3-acb815e2e3ba None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:34.857290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e901566-d86e-47c5-bcc3-acb815e2e3ba None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:34.857604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e901566-d86e-47c5-bcc3-acb815e2e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:34.878425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0e901566-d86e-47c5-bcc3-acb815e2e3ba None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:34.880196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0e901566-d86e-47c5-bcc3-acb815e2e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:34.949535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 622/1221] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 18:47:34.973415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf3e51-c7e5-42ff-95c4-fc563b7ee552 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:35.091580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf3e51-c7e5-42ff-95c4-fc563b7ee552 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:35.128153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aecdf-6808-4629-9080-a0d1aa9c9b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:35.129214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aecdf-6808-4629-9080-a0d1aa9c9b18 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:35.129643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aecdf-6808-4629-9080-a0d1aa9c9b18 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:35.130073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aecdf-6808-4629-9080-a0d1aa9c9b18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:35.141567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aecdf-6808-4629-9080-a0d1aa9c9b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-771aecdf-6808-4629-9080-a0d1aa9c9b18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:47:35.150574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:35.151726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:47:35.152751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:35.154695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 600/1222] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:47:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:47:35.160745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e901566-d86e-47c5-bcc3-acb815e2e3ba None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:35.276119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e901566-d86e-47c5-bcc3-acb815e2e3ba None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:35.314930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:35.315763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:35.316111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:35.316450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:35.317309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] RBAC: Adding query filter params (name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:35.317658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:35.319314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:35.330533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 623/1223] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:47:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:35.336421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aecdf-6808-4629-9080-a0d1aa9c9b18 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:35.502249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aecdf-6808-4629-9080-a0d1aa9c9b18 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:35.541047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:35.542113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:35.542395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:35.542667 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:35.554595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:35.556100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:35.574678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:35.575915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:35.576845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:35.576845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:35.576845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:35.576845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:35.576845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 601/1224] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:35.581925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:35.690442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7764ed-e256-49fe-84cb-f5e02b312f2b None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:35.726433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:35.727123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:35.727471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:35.727748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:35.728521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:35.728825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:35.730215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:35.742876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 624/1225] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:35.748531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:35.873399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c60cb2-a35f-47fb-8e62-6a3fc9877e83 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:35.916261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:35.917547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:35.917997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:35.918317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] PATH_INFO: `/v3/users/placement` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:35.927215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:35.929002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:47:35.947061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:35.948342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:35.949497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 602/1226] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:35.956353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:36.064888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efa56a-3289-4af2-878a-d286e0f25ecc None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:36.101918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:36.102588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:36.102866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:36.103134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:36.104012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:36.104315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:36.105758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:36.128459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 625/1227] 10.222.0.93 () {56 vars in 1143 bytes} [Wed May 11 18:47:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:36.135035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:36.255398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f8d42-3ceb-4df9-b41f-979fc89fa7de None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:36.290318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:36.291108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:36.291419 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:36.291692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:36.303709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:36.305281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:36.324993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:36.326046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:36.327033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:36.327033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:36.327033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:36.327033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:36.327033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 603/1228] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:36.332980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:36.460740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5ed7-f38e-43e7-a0bc-90bcc3b16883 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:36.503832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:36.504501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:36.504782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:36.505055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:36.505767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:36.506073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:36.507749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:36.520835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 626/1229] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:36.526604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:36.640612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ac011-8543-43db-8a66-12a203bf2510 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:36.677015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:36.677803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:36.678078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:36.678347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:36.686019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:36.687549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:47:36.703879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:36.704839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:36.705718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 604/1230] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:47:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:36.711246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:36.817352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a927d7-4386-40d8-a3f3-1f9273e2c34a None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:36.854451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47de158-27ab-4447-9f90-726bbce6d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:36.855116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47de158-27ab-4447-9f90-726bbce6d315 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:36.855426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47de158-27ab-4447-9f90-726bbce6d315 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:36.855701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47de158-27ab-4447-9f90-726bbce6d315 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:36.856475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47de158-27ab-4447-9f90-726bbce6d315 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:36.856781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47de158-27ab-4447-9f90-726bbce6d315 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:36.858253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47de158-27ab-4447-9f90-726bbce6d315 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:36.871448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 627/1231] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:47:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:36.877673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:36.983551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219fff5-c643-4125-8d00-a26e901d6ed2 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:37.022511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e71007-f620-49c3-89a5-e9c8dc8ac955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:37.023544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e71007-f620-49c3-89a5-e9c8dc8ac955 None admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:37.023820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e71007-f620-49c3-89a5-e9c8dc8ac955 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:37.024119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e71007-f620-49c3-89a5-e9c8dc8ac955 None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/911d21a666844fc399286e24c2892184/roles/e46746a1257a4ec8a138a0a31e80a8da` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:37.038977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e71007-f620-49c3-89a5-e9c8dc8ac955 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=911d21a666844fc399286e24c2892184, role_id=e46746a1257a4ec8a138a0a31e80a8da)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:37.040534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e71007-f620-49c3-89a5-e9c8dc8ac955 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:37.053707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 605/1232] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:47:36 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/911d21a666844fc399286e24c2892184/roles/e46746a1257a4ec8a138a0a31e80a8da => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:47:39.410217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03380ef-2eac-4f2e-86e0-062b9ce73948 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:39.410794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03380ef-2eac-4f2e-86e0-062b9ce73948 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:39.410794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03380ef-2eac-4f2e-86e0-062b9ce73948 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:39.412169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 628/1233] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:39.418083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e6e0-5877-421d-8cf2-79ed419746d9 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:39.418536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e6e0-5877-421d-8cf2-79ed419746d9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:39.418638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e6e0-5877-421d-8cf2-79ed419746d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:39.436126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-df23e6e0-5877-421d-8cf2-79ed419746d9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:39.438124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-df23e6e0-5877-421d-8cf2-79ed419746d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:39.516913 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 606/1234] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:47:39.544056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03380ef-2eac-4f2e-86e0-062b9ce73948 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:39.649474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03380ef-2eac-4f2e-86e0-062b9ce73948 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:39.686519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b222c-a28c-4e7b-b681-c40be9190c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:39.687937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b222c-a28c-4e7b-b681-c40be9190c04 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:39.688216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b222c-a28c-4e7b-b681-c40be9190c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:39.688488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b222c-a28c-4e7b-b681-c40be9190c04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:39.699019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b222c-a28c-4e7b-b681-c40be9190c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-3e3b222c-a28c-4e7b-b681-c40be9190c04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:47:39.707355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:39.708331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:39.709488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 629/1235] 10.222.0.93 () {56 vars in 1102 bytes} [Wed May 11 18:47:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:39.714818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23e6e0-5877-421d-8cf2-79ed419746d9 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:39.826837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23e6e0-5877-421d-8cf2-79ed419746d9 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:39.868326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:39.869005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:39.869290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:39.869563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:39.870311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] RBAC: Adding query filter params (name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:39.870615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:39.872034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:39.886148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 607/1236] 10.222.0.93 () {56 vars in 1103 bytes} [Wed May 11 18:47:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:39.887323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b222c-a28c-4e7b-b681-c40be9190c04 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:39.994510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b222c-a28c-4e7b-b681-c40be9190c04 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:40.029591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:40.030558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:40.031380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:40.031650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:40.043696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:40.045461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:40.063205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:40.064621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:40.070103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:40.070103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:40.070103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:40.070103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:40.070103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 630/1237] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:40.070391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:40.170797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c9a19-e9f9-4232-b38d-a0dd467de49b None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:40.215699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:40.216617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:40.217145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:40.217326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:40.218820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:40.219223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:40.220987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:40.236266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 608/1238] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:40.242176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:40.357507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4693d2-87bc-4ec0-b0fe-5db51ae401a1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:40.394225 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:40.395174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:40.395570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:40.395875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:40.406439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:40.408092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:47:40.423435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:40.429575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:40.430837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 631/1239] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:40.431603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:40.548973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b97fb8-e692-40fb-ac7b-2f4cf69c988e None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:40.588247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:40.589047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:40.589319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:40.589589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:40.590546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:40.590852 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:40.592555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:40.612840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 609/1240] 10.222.0.93 () {56 vars in 1143 bytes} [Wed May 11 18:47:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:40.618784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:40.721597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5735-46be-49d3-b5c4-06aff4ba56e7 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:40.754693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3564f9-813d-47c6-bd1c-742ca3ecd203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:40.755360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3564f9-813d-47c6-bd1c-742ca3ecd203 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:40.755638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3564f9-813d-47c6-bd1c-742ca3ecd203 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:40.755904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3564f9-813d-47c6-bd1c-742ca3ecd203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:40.832960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3564f9-813d-47c6-bd1c-742ca3ecd203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:40.834629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3564f9-813d-47c6-bd1c-742ca3ecd203 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:40.948015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 632/1241] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:47:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:47:40.954733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:41.061610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5a1f-dab4-4ca8-a81d-f2fe5440491d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:41.096213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:41.097001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:41.097298 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:41.097561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:41.108146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:41.110558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:41.128679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:41.129710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:41.130765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:41.130765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:41.130765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:41.130765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:41.130765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 610/1242] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:47:41.135757 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3564f9-813d-47c6-bd1c-742ca3ecd203 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:41.241451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3564f9-813d-47c6-bd1c-742ca3ecd203 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:41.277838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:41.278568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:41.278887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:41.279170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:41.280025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:41.280336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:41.281855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:41.293433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 633/1243] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:41.300073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:41.405098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fccfe7-354e-4537-aa10-f38839c59a7a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:41.440330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:41.441120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:41.441411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:41.441773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:41.448671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:41.450122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:47:41.464239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:41.465205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:41.466285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 611/1244] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:47:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:41.471614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:41.580045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d142088-ab0d-467b-9240-c1aef7fd21b5 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:41.616217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc57828-c0f3-40b2-b503-9f8cce6979ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:41.616921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57828-c0f3-40b2-b503-9f8cce6979ca None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:41.617268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57828-c0f3-40b2-b503-9f8cce6979ca None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:41.617573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57828-c0f3-40b2-b503-9f8cce6979ca None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:41.618446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc57828-c0f3-40b2-b503-9f8cce6979ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:41.618748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc57828-c0f3-40b2-b503-9f8cce6979ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:41.620341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc57828-c0f3-40b2-b503-9f8cce6979ca None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:41.634486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 634/1245] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:47:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:41.640605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:41.743735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62846e6-9335-48da-82dd-d476eae5fe8e None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:41.777662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61d5a-7d20-49d2-a0be-cd99e76cd812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:41.778328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61d5a-7d20-49d2-a0be-cd99e76cd812 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:41.778610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61d5a-7d20-49d2-a0be-cd99e76cd812 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:41.778880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61d5a-7d20-49d2-a0be-cd99e76cd812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:41.779792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61d5a-7d20-49d2-a0be-cd99e76cd812 None admin] RBAC: Adding query filter params (role.id=e46746a1257a4ec8a138a0a31e80a8da, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=911d21a666844fc399286e24c2892184) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:41.780059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61d5a-7d20-49d2-a0be-cd99e76cd812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:41.782015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61d5a-7d20-49d2-a0be-cd99e76cd812 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:41.787921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 612/1246] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:47:41 2022] GET /identity/v3/role_assignments?user.id=911d21a666844fc399286e24c2892184&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=e46746a1257a4ec8a138a0a31e80a8da => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:44.288013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7b59-2adc-4d31-b8c5-a7adb6cc1d81 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:44.288554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7b59-2adc-4d31-b8c5-a7adb6cc1d81 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:44.288645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7b59-2adc-4d31-b8c5-a7adb6cc1d81 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:44.290327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 635/1247] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:44.295776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db547ce8-6ee0-4d36-ac33-87765c4e449e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:44.296703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db547ce8-6ee0-4d36-ac33-87765c4e449e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:44.296844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db547ce8-6ee0-4d36-ac33-87765c4e449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:44.314676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-db547ce8-6ee0-4d36-ac33-87765c4e449e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:44.316292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-db547ce8-6ee0-4d36-ac33-87765c4e449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:44.390541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 613/1248] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:47:44.413518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d7b59-2adc-4d31-b8c5-a7adb6cc1d81 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:44.529766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d7b59-2adc-4d31-b8c5-a7adb6cc1d81 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:44.567696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d2ad2-ff7e-4e6d-8e77-ca8f8cf87ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:44.568736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2ad2-ff7e-4e6d-8e77-ca8f8cf87ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:44.569207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2ad2-ff7e-4e6d-8e77-ca8f8cf87ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:44.569479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2ad2-ff7e-4e6d-8e77-ca8f8cf87ea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:44.580085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d2ad2-ff7e-4e6d-8e77-ca8f8cf87ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-ba8d2ad2-ff7e-4e6d-8e77-ca8f8cf87ea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:47:44.588461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:44.589612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:44.590567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 636/1249] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:47:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:44.596685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db547ce8-6ee0-4d36-ac33-87765c4e449e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:44.704756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db547ce8-6ee0-4d36-ac33-87765c4e449e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:44.743442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:44.744108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:44.744390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:44.744715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:44.745621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:44.745958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:44.747759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:44.756961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 614/1250] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:47:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:44.762715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d2ad2-ff7e-4e6d-8e77-ca8f8cf87ea0 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:44.863896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d2ad2-ff7e-4e6d-8e77-ca8f8cf87ea0 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:44.898999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:44.899812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:44.900091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:44.900361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:44.914013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:44.915590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:44.935282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:44.939380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:44.941435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:44.941435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:44.941435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:44.941435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:44.941435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 637/1251] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:44.945683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:45.051459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c4e42-aed9-4a11-98f4-b08d505424e1 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:45.088548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:45.089361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:45.089653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:45.089980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:45.090785 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:45.091126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:45.092721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:45.105740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 615/1252] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:45.112546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:45.222992 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f842ce-0671-4d0c-b2d8-7437e807d392 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:45.266144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:45.266990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:45.267331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:45.267600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:45.275996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:45.277620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:47:45.293260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:45.294878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:45.295932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 638/1253] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:45.301352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:45.411825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a1e43-338b-4156-bf6a-82af69b4c100 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:45.451532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:45.452237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:45.453053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:45.453327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:45.454170 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:45.454480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:45.456084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:45.476348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 616/1254] 10.222.0.93 () {56 vars in 1143 bytes} [Wed May 11 18:47:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:45.482215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:45.600030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1931699-a2a2-41ec-87f9-fe3c678721e4 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:45.634530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11598f85-7e54-4cc2-8550-90f19a2f9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:45.635192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598f85-7e54-4cc2-8550-90f19a2f9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:45.635506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598f85-7e54-4cc2-8550-90f19a2f9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:45.635784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598f85-7e54-4cc2-8550-90f19a2f9fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:45.705088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11598f85-7e54-4cc2-8550-90f19a2f9fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:45.706594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11598f85-7e54-4cc2-8550-90f19a2f9fd6 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:45.812494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 639/1255] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:47:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 18:47:45.818781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:45.916733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de252af5-6082-47cf-94c6-01277cdd5455 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:45.950235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:45.951061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:45.951379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:45.951626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:45.961553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:45.962975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:45.980047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:45.981110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:45.982256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:45.982256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:45.982256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:45.982256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:45.982256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 617/1256] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:45.988866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11598f85-7e54-4cc2-8550-90f19a2f9fd6 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:46.085886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11598f85-7e54-4cc2-8550-90f19a2f9fd6 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:46.118823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:46.119499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:46.119774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:46.120038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:46.120740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:46.121039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:46.122404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:46.133025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 640/1257] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:46.138623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:46.233262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000b559-353a-4afe-ab0d-2dd8cc236e4c None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:46.265638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:46.266413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:46.266692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:46.266961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:46.273420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:46.274865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:47:46.288942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:46.289999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:46.291415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 618/1258] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:47:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:46.298711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:46.393306 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f9b16-75f9-44b4-aa0f-2f5e7e070916 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:46.424255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923f4c3-81e1-4a75-81d1-bc9c8a0a0715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:46.424895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f4c3-81e1-4a75-81d1-bc9c8a0a0715 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:46.425169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f4c3-81e1-4a75-81d1-bc9c8a0a0715 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:46.425435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f4c3-81e1-4a75-81d1-bc9c8a0a0715 None admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:46.426196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923f4c3-81e1-4a75-81d1-bc9c8a0a0715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:46.426496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923f4c3-81e1-4a75-81d1-bc9c8a0a0715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:46.427942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923f4c3-81e1-4a75-81d1-bc9c8a0a0715 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:46.441047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 641/1259] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:46.446956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:46.548288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513043cd-d4aa-4a83-ad7f-5efda974777a None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:46.580279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5334e-619c-4063-b523-5c7a52f40851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:46.580918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5334e-619c-4063-b523-5c7a52f40851 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:46.581196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5334e-619c-4063-b523-5c7a52f40851 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:46.581468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5334e-619c-4063-b523-5c7a52f40851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:46.582289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5334e-619c-4063-b523-5c7a52f40851 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=911d21a666844fc399286e24c2892184) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:46.582599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5334e-619c-4063-b523-5c7a52f40851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:46.584051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5334e-619c-4063-b523-5c7a52f40851 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:46.589268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 619/1260] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:47:46 2022] GET /identity/v3/role_assignments?user.id=911d21a666844fc399286e24c2892184&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:48.757257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2ee5-7a18-42a9-9ff0-99a7570f1a61 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:48.757815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2ee5-7a18-42a9-9ff0-99a7570f1a61 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:48.757815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2ee5-7a18-42a9-9ff0-99a7570f1a61 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:48.759169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 642/1261] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:48.764388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42d6da-6d52-4299-b656-7baa7608b8c0 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:48.765311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42d6da-6d52-4299-b656-7baa7608b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:48.765437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42d6da-6d52-4299-b656-7baa7608b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:48.782111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-be42d6da-6d52-4299-b656-7baa7608b8c0 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:48.783274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-be42d6da-6d52-4299-b656-7baa7608b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:48.844810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 620/1262] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:47:48.867061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b2ee5-7a18-42a9-9ff0-99a7570f1a61 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:48.966946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b2ee5-7a18-42a9-9ff0-99a7570f1a61 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:48.998632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f5a17-7e6e-4582-b968-8324eef361ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:48.999966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f5a17-7e6e-4582-b968-8324eef361ca None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:49.000249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f5a17-7e6e-4582-b968-8324eef361ca None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:49.000524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f5a17-7e6e-4582-b968-8324eef361ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:49.010129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f5a17-7e6e-4582-b968-8324eef361ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-c53f5a17-7e6e-4582-b968-8324eef361ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:47:49.018208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:49.019286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:49.020346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 643/1263] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:47:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:49.025387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42d6da-6d52-4299-b656-7baa7608b8c0 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:49.117166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42d6da-6d52-4299-b656-7baa7608b8c0 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:49.148016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:49.148655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:49.148927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:49.149194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:49.149921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:49.150218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:49.151602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:49.159729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 621/1264] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:47:49.165434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f5a17-7e6e-4582-b968-8324eef361ca None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:49.261124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f5a17-7e6e-4582-b968-8324eef361ca None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:49.292388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:49.293156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:49.293440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:49.293710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:49.304238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:49.305673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:49.322156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:49.323167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:49.324129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:49.324129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:49.324129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:49.324129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:49.324129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 644/1265] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:49.329010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:49.421783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce97cae-587a-42f0-9583-84c78dd1e231 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:49.455188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:49.455934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:49.456242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:49.456564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:49.457304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:49.457602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:49.459094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:49.472346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 622/1266] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:49.478699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:49.583276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900389bc-44a8-47dc-9882-9ae94f38768f None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:49.614814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:49.615627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:49.615908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:49.616180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:49.623287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:49.624771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:47:49.638637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:49.640214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:49.641571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 645/1267] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:49.646136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:49.745011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692527d-e76c-488d-b734-7cdf0ebce179 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:49.777127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:49.777784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:49.778060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:49.778330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:49.779163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:49.779496 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:49.780977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:49.797163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 623/1268] 10.222.0.93 () {56 vars in 1143 bytes} [Wed May 11 18:47:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:49.802866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:49.897977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ff2d-3cc1-4cf7-b0b3-9f2ccaf34d07 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:49.928997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:49.929773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:49.930052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:49.930328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:49.941797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:49.943246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:49.960256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:49.961264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:49.962355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:49.962355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:49.962355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:49.962355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:49.962355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 646/1269] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:49.968543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:50.062865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9831e-6b50-4538-b894-199c77d1e749 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:50.096053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:50.096703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:50.096980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:50.097251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:50.097959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:50.098266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:50.099665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:50.110971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 624/1270] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:50.116585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:50.209716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc014a-eb54-46d2-b8b7-d86db418b0f3 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:50.240937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:50.241704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:50.241977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:50.242241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:50.248551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:50.250570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:47:50.264151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:50.265229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:50.266375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 647/1271] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:50.271106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:50.371211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b18bf-bf35-456f-b85e-c36b6bcedb22 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:50.403213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7e073-0cd6-4975-830f-77fd431aa46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:50.403894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7e073-0cd6-4975-830f-77fd431aa46d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:50.404171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7e073-0cd6-4975-830f-77fd431aa46d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:50.404443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7e073-0cd6-4975-830f-77fd431aa46d None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:50.405243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7e073-0cd6-4975-830f-77fd431aa46d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:50.405554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7e073-0cd6-4975-830f-77fd431aa46d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:50.406977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7e073-0cd6-4975-830f-77fd431aa46d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:50.418414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 625/1272] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:50.424847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:50.527193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c48a8-3d2f-4f5c-8bbb-35f0d9fc0c87 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:50.559641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caee72-4dfd-4aac-b4ea-2ae284fc1cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:50.560509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caee72-4dfd-4aac-b4ea-2ae284fc1cca None admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:50.560790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caee72-4dfd-4aac-b4ea-2ae284fc1cca None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:50.561062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caee72-4dfd-4aac-b4ea-2ae284fc1cca None admin] PATH_INFO: `/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/911d21a666844fc399286e24c2892184/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:50.563023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caee72-4dfd-4aac-b4ea-2ae284fc1cca None admin] RBAC: Authorizing `identity:create_grant(project_id=6b016ff3f3e34751a814a9d91930e2d6, user_id=911d21a666844fc399286e24c2892184, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:50.564754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caee72-4dfd-4aac-b4ea-2ae284fc1cca None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:50.576738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 648/1273] 10.222.0.93 () {58 vars in 1439 bytes} [Wed May 11 18:47:50 2022] PUT /identity/v3/projects/6b016ff3f3e34751a814a9d91930e2d6/users/911d21a666844fc399286e24c2892184/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:47:52.778676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88f2fd-0b3f-4c69-8815-53d30ddd4f88 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:52.779204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88f2fd-0b3f-4c69-8815-53d30ddd4f88 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:52.779349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88f2fd-0b3f-4c69-8815-53d30ddd4f88 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:52.781150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 626/1274] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:52.786232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca12c9b-6687-4001-b727-7dde9a4c9804 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:52.786682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca12c9b-6687-4001-b727-7dde9a4c9804 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:52.786774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca12c9b-6687-4001-b727-7dde9a4c9804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:52.803509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9ca12c9b-6687-4001-b727-7dde9a4c9804 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:52.804680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9ca12c9b-6687-4001-b727-7dde9a4c9804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:52.867198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 649/1275] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:47:52.889789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88f2fd-0b3f-4c69-8815-53d30ddd4f88 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:52.988802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88f2fd-0b3f-4c69-8815-53d30ddd4f88 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:53.024424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51d299-ba64-4af1-956d-1b2ff3de669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:53.025212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d299-ba64-4af1-956d-1b2ff3de669e None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:53.025492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d299-ba64-4af1-956d-1b2ff3de669e None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:53.025767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d299-ba64-4af1-956d-1b2ff3de669e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:53.036012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51d299-ba64-4af1-956d-1b2ff3de669e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-4f51d299-ba64-4af1-956d-1b2ff3de669e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 18:47:53.043611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:53.044662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:53.045521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 627/1276] 10.222.0.93 () {56 vars in 1096 bytes} [Wed May 11 18:47:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:47:53.051578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca12c9b-6687-4001-b727-7dde9a4c9804 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:53.143800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca12c9b-6687-4001-b727-7dde9a4c9804 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:53.175650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:53.176303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:53.176582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:53.176854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:53.177593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:53.177896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:53.179263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:53.186903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 650/1277] 10.222.0.93 () {56 vars in 1099 bytes} [Wed May 11 18:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:53.192850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51d299-ba64-4af1-956d-1b2ff3de669e None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:53.287562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51d299-ba64-4af1-956d-1b2ff3de669e None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:53.318356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:53.319135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:53.319444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:53.319715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:53.330184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:53.331641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:53.348391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:53.349428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:53.350835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:53.350835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:53.350835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:53.350835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:53.350835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 628/1278] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:53.355174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:53.450592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd76096-a0ee-4d7e-9e42-02ce41d35f4d None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:53.491486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:53.492257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:53.492541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:53.492827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:53.493565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:53.493846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:53.495216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:53.507500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 651/1279] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:53.513871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:53.607574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ab5c0-7fb7-4ab8-b7dd-a71f5f05a0f7 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:53.638770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:53.639640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:53.640405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:53.640674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:53.647786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:53.649202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 18:47:53.662904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:53.663993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:53.665293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 629/1280] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:53.669669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:53.762615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9da681-dcb9-4891-8577-85fd66e15897 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:53.794782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:53.795466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:53.795748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:53.796020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:53.796845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:53.797153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:53.798582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:53.815516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 652/1281] 10.222.0.93 () {56 vars in 1143 bytes} [Wed May 11 18:47:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:53.821058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:53.914331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edea7-9f5f-4462-85ca-48c6b5dc1731 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:53.945977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131e618-6812-4726-a57a-09cd7ec4eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:53.946594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131e618-6812-4726-a57a-09cd7ec4eabb None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:53.946868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131e618-6812-4726-a57a-09cd7ec4eabb None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:53.947132 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131e618-6812-4726-a57a-09cd7ec4eabb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:54.009003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131e618-6812-4726-a57a-09cd7ec4eabb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:54.010410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131e618-6812-4726-a57a-09cd7ec4eabb None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:54.100743 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 630/1282] 10.222.0.93 () {58 vars in 1282 bytes} [Wed May 11 18:47:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 18:47:54.106288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:54.200460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dffe6-85df-42a8-be78-6a778ec0ef64 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:54.231831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:54.232606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:54.232882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:54.233150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:54.243258 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:54.244757 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 18:47:54.262082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:54.263079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:54.264016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 18:47:54.264016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 18:47:54.264016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 18:47:54.264016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:54.264016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 653/1283] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:54.269018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131e618-6812-4726-a57a-09cd7ec4eabb None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:54.364124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131e618-6812-4726-a57a-09cd7ec4eabb None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:54.400654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:54.401309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:54.401587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:54.401856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:54.402571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:54.402875 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:54.404253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:54.415596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 631/1284] 10.222.0.93 () {56 vars in 1109 bytes} [Wed May 11 18:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:54.422015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:54.519848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac83f7-28e2-4ebd-83f6-f913af3e4548 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:54.552959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:54.553730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:54.554004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:54.554271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:54.560605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:54.562054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 18:47:54.575474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application with Lock( May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:54.576489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: ERROR keystone.server.flask.application May 11 18:47:54.577790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 654/1285] 10.222.0.93 () {56 vars in 1111 bytes} [Wed May 11 18:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:47:54.582430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:54.675990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55418d4-d674-4e2c-bf0a-439a6c9bb068 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:54.707693 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8dbf7-8011-49a1-9c88-3c82e4d58e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:54.708335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8dbf7-8011-49a1-9c88-3c82e4d58e81 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:54.708615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8dbf7-8011-49a1-9c88-3c82e4d58e81 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:54.708887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8dbf7-8011-49a1-9c88-3c82e4d58e81 None admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:54.709663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8dbf7-8011-49a1-9c88-3c82e4d58e81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:54.709970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8dbf7-8011-49a1-9c88-3c82e4d58e81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:54.711407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8dbf7-8011-49a1-9c88-3c82e4d58e81 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:54.723378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 632/1286] 10.222.0.93 () {56 vars in 1148 bytes} [Wed May 11 18:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:54.729293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:54.822525 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd9d1c-f51d-447b-8a5c-2384480690dc None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:54.854384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba971-48d9-44cd-8ebb-3bd279e74362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:54.855007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba971-48d9-44cd-8ebb-3bd279e74362 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:54.855284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba971-48d9-44cd-8ebb-3bd279e74362 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:54.855584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba971-48d9-44cd-8ebb-3bd279e74362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:54.856394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ba971-48d9-44cd-8ebb-3bd279e74362 None admin] RBAC: Adding query filter params (role.id=7e1f5b10c66c4b2c91ad4544ab6fc743, scope.project.id=6b016ff3f3e34751a814a9d91930e2d6, user.id=911d21a666844fc399286e24c2892184) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:54.856704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ba971-48d9-44cd-8ebb-3bd279e74362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:54.858112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ba971-48d9-44cd-8ebb-3bd279e74362 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:54.863687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 655/1287] 10.222.0.93 () {56 vars in 1374 bytes} [Wed May 11 18:47:54 2022] GET /identity/v3/role_assignments?user.id=911d21a666844fc399286e24c2892184&scope.project.id=6b016ff3f3e34751a814a9d91930e2d6&role.id=7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:57.082286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53a48-d4ff-4269-bcae-57db91fba01c None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:57.082848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53a48-d4ff-4269-bcae-57db91fba01c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:57.082848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53a48-d4ff-4269-bcae-57db91fba01c None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:57.084202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 633/1288] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:57.089363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20033569-7ae0-43f9-8fb3-60b97f3007d2 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:57.089728 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20033569-7ae0-43f9-8fb3-60b97f3007d2 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:57.089919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20033569-7ae0-43f9-8fb3-60b97f3007d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:57.106094 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-20033569-7ae0-43f9-8fb3-60b97f3007d2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:57.107277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-20033569-7ae0-43f9-8fb3-60b97f3007d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:57.169444 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 656/1289] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:47:57.192249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d53a48-d4ff-4269-bcae-57db91fba01c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:57.288137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d53a48-d4ff-4269-bcae-57db91fba01c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:57.319823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:57.320596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:57.320871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:57.321136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] PATH_INFO: `/v3/services/placement` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:57.321798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:57.323148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:47:57.334662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:47:57.335963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:47:57.337080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 634/1290] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:47:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 18:47:57.341808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20033569-7ae0-43f9-8fb3-60b97f3007d2 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:57.433882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20033569-7ae0-43f9-8fb3-60b97f3007d2 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:57.469956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b552d7-afb1-4a51-8e13-ed681d182506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:57.470729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b552d7-afb1-4a51-8e13-ed681d182506 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:57.471010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b552d7-afb1-4a51-8e13-ed681d182506 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:57.471341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b552d7-afb1-4a51-8e13-ed681d182506 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:57.472096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b552d7-afb1-4a51-8e13-ed681d182506 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:57.472443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b552d7-afb1-4a51-8e13-ed681d182506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:57.473986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b552d7-afb1-4a51-8e13-ed681d182506 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:57.479250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 657/1291] 10.222.0.93 () {56 vars in 1116 bytes} [Wed May 11 18:47:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:57.486087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:57.585288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47728fa-98de-4fd0-bdfd-95af7b36fd0d None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:47:57.617035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf952c95-b3ed-4198-9cf3-1b59ba4f633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:47:57.617688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952c95-b3ed-4198-9cf3-1b59ba4f633d None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:57.617969 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952c95-b3ed-4198-9cf3-1b59ba4f633d None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:57.618241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952c95-b3ed-4198-9cf3-1b59ba4f633d None admin] PATH_INFO: `/v3/services` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:57.618938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf952c95-b3ed-4198-9cf3-1b59ba4f633d None admin] RBAC: Adding query filter params (type=placement) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:47:57.619240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf952c95-b3ed-4198-9cf3-1b59ba4f633d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:47:57.620614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf952c95-b3ed-4198-9cf3-1b59ba4f633d None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:47:57.624849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 635/1292] 10.222.0.93 () {56 vars in 1116 bytes} [Wed May 11 18:47:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:47:59.782695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2495-2eab-4703-8d2f-82283cdef35c None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:59.783212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2495-2eab-4703-8d2f-82283cdef35c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:59.783353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2495-2eab-4703-8d2f-82283cdef35c None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:59.784618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 658/1293] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:47:59.789678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177eac6-1848-4402-b5dd-263789468130 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:47:59.790096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177eac6-1848-4402-b5dd-263789468130 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:47:59.790224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177eac6-1848-4402-b5dd-263789468130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:47:59.806981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b177eac6-1848-4402-b5dd-263789468130 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:47:59.808177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b177eac6-1848-4402-b5dd-263789468130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:47:59.870337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 636/1294] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:47:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:47:59.892843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2495-2eab-4703-8d2f-82283cdef35c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:47:59.989791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2495-2eab-4703-8d2f-82283cdef35c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:48:00.022115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534994a-9211-44cc-8bbd-7d9da938abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:48:00.022761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534994a-9211-44cc-8bbd-7d9da938abf2 None admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:00.023043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534994a-9211-44cc-8bbd-7d9da938abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:00.023340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534994a-9211-44cc-8bbd-7d9da938abf2 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:00.024048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534994a-9211-44cc-8bbd-7d9da938abf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:48:00.025431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534994a-9211-44cc-8bbd-7d9da938abf2 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:48:00.038840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 659/1295] 10.222.0.93 () {60 vars in 1141 bytes} [Wed May 11 18:47:59 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:48:02.216186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f2d9-cf97-492b-8759-99a1d55f96e1 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:02.216697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f2d9-cf97-492b-8759-99a1d55f96e1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:02.216797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f2d9-cf97-492b-8759-99a1d55f96e1 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:02.218705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 637/1296] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:48:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:48:02.223933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1777dc9-54e8-41b8-8244-fb43d2f4fbac None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:02.224303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1777dc9-54e8-41b8-8244-fb43d2f4fbac None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:02.224487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1777dc9-54e8-41b8-8244-fb43d2f4fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:02.240663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a1777dc9-54e8-41b8-8244-fb43d2f4fbac None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:48:02.241831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a1777dc9-54e8-41b8-8244-fb43d2f4fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:48:02.309695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 660/1297] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:48:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:48:02.332631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f2d9-cf97-492b-8759-99a1d55f96e1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:48:02.426339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f2d9-cf97-492b-8759-99a1d55f96e1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:48:02.466793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:48:02.468275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:02.468899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:02.469257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:02.470189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:48:02.472813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:48:02.484918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:48:02.486079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:48:02.486995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 638/1298] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:48:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:48:02.492379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1777dc9-54e8-41b8-8244-fb43d2f4fbac None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:48:02.585296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1777dc9-54e8-41b8-8244-fb43d2f4fbac None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:48:02.617690 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:48:02.618339 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:02.618625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:02.618901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:02.619625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:48:02.619933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:48:02.621300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:48:02.626717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 661/1299] 10.222.0.93 () {56 vars in 1116 bytes} [Wed May 11 18:48:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:48:02.632471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:48:02.725657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3a8c-955f-4405-870e-5ff2f6e63719 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:48:02.756724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b100f9-0421-4090-9873-69ec75cf710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:48:02.757353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b100f9-0421-4090-9873-69ec75cf710f None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:02.757633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b100f9-0421-4090-9873-69ec75cf710f None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:02.757901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b100f9-0421-4090-9873-69ec75cf710f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:02.758672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b100f9-0421-4090-9873-69ec75cf710f None admin] RBAC: Adding query filter params (interface=public, service_id=475052741f2c4dcb888f63bbe5b1eea5, region_id=RegionOne) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:48:02.758978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b100f9-0421-4090-9873-69ec75cf710f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:48:02.760351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b100f9-0421-4090-9873-69ec75cf710f None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:48:02.765646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 639/1300] 10.222.0.93 () {56 vars in 1251 bytes} [Wed May 11 18:48:02 2022] GET /identity/v3/endpoints?service_id=475052741f2c4dcb888f63bbe5b1eea5&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:48:02.770948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:48:02.863436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e625-2998-4442-a6de-c4e6a79025d1 None admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:48:02.894962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fab666-62ad-42dc-9a60-9bc5aa1f0482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:48:02.895634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fab666-62ad-42dc-9a60-9bc5aa1f0482 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:02.895920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fab666-62ad-42dc-9a60-9bc5aa1f0482 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:02.896197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fab666-62ad-42dc-9a60-9bc5aa1f0482 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:02.896865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fab666-62ad-42dc-9a60-9bc5aa1f0482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:48:02.898211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fab666-62ad-42dc-9a60-9bc5aa1f0482 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:48:02.904890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 662/1301] 10.222.0.93 () {56 vars in 1087 bytes} [Wed May 11 18:48:02 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:48:05.160771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35370161-4a35-4926-903f-e18018edf886 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:05.161295 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35370161-4a35-4926-903f-e18018edf886 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:05.161295 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35370161-4a35-4926-903f-e18018edf886 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:05.162665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 640/1302] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:48:05.167954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6bcb6-dcc2-4509-874f-c73df65d9d08 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:05.168367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6bcb6-dcc2-4509-874f-c73df65d9d08 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:05.168510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6bcb6-dcc2-4509-874f-c73df65d9d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:05.184701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-1cb6bcb6-dcc2-4509-874f-c73df65d9d08 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:48:05.185878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1cb6bcb6-dcc2-4509-874f-c73df65d9d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:48:05.249272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 663/1303] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:48:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 18:48:05.272202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35370161-4a35-4926-903f-e18018edf886 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:48:05.367639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35370161-4a35-4926-903f-e18018edf886 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:48:05.398729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:48:05.399532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:05.399808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:05.400072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:05.400714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:48:05.402061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 18:48:05.414094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 18:48:05.415186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.get_or_create( May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application with Lock( May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self._enter() May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application return self.creator() May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application created_value = creator( May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: ERROR keystone.server.flask.application May 11 18:48:05.416344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 641/1304] 10.222.0.93 () {56 vars in 1117 bytes} [Wed May 11 18:48:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 18:48:05.421272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6bcb6-dcc2-4509-874f-c73df65d9d08 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:48:05.515081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6bcb6-dcc2-4509-874f-c73df65d9d08 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:48:05.546408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4df7-bc67-41b8-a72a-4e000e48b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:48:05.547051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4df7-bc67-41b8-a72a-4e000e48b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:05.547352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4df7-bc67-41b8-a72a-4e000e48b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:05.547624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4df7-bc67-41b8-a72a-4e000e48b0c0 None admin] PATH_INFO: `/v3/services` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:05.548310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4df7-bc67-41b8-a72a-4e000e48b0c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:48:05.548612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4df7-bc67-41b8-a72a-4e000e48b0c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:48:05.549966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4df7-bc67-41b8-a72a-4e000e48b0c0 None admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:48:05.554851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 664/1305] 10.222.0.93 () {56 vars in 1116 bytes} [Wed May 11 18:48:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:48:05.560645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:48:05.657539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bdafb-5b08-438f-bd9c-089419dff226 None admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:48:05.689195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c1015-dae1-47cf-8063-ad5a28a1abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:48:05.689775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1015-dae1-47cf-8063-ad5a28a1abbe None admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:48:05.690057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1015-dae1-47cf-8063-ad5a28a1abbe None admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:48:05.690332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1015-dae1-47cf-8063-ad5a28a1abbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:48:05.691072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c1015-dae1-47cf-8063-ad5a28a1abbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:48:05.692469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c1015-dae1-47cf-8063-ad5a28a1abbe None admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:48:05.710110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 642/1306] 10.222.0.93 () {60 vars in 1144 bytes} [Wed May 11 18:48:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:49:09.100919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbce2f-b01e-4496-8208-ca2bbe1d54cf None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:09.101940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbce2f-b01e-4496-8208-ca2bbe1d54cf None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:09.102418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbce2f-b01e-4496-8208-ca2bbe1d54cf None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:09.109994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e411c6f-d27d-4019-924f-875c90b6ef67 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:09.110967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e411c6f-d27d-4019-924f-875c90b6ef67 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:09.111469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e411c6f-d27d-4019-924f-875c90b6ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:09.115164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 665/1307] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:09 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:09.231065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-1e411c6f-d27d-4019-924f-875c90b6ef67 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:09.232307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1e411c6f-d27d-4019-924f-875c90b6ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:09.403325 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 643/1308] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:49:09.447745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f622d4-3dac-4416-b9c8-18da3c965e68 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:09.448090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f622d4-3dac-4416-b9c8-18da3c965e68 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:09.448581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f622d4-3dac-4416-b9c8-18da3c965e68 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:09.450430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 666/1309] 10.222.0.93 () {54 vars in 964 bytes} [Wed May 11 18:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:09.457006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312a03-1e2a-4e74-b79c-fb3cfede6948 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:09.457301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312a03-1e2a-4e74-b79c-fb3cfede6948 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:09.457584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312a03-1e2a-4e74-b79c-fb3cfede6948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:09.572707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b7312a03-1e2a-4e74-b79c-fb3cfede6948 None None] MFA Rules not processed for user `af0204b62913420a90303c42dbded7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:09.576029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b7312a03-1e2a-4e74-b79c-fb3cfede6948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:09.710521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 644/1310] 10.222.0.93 () {58 vars in 1061 bytes} [Wed May 11 18:49:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:09.722952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f622d4-3dac-4416-b9c8-18da3c965e68 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:09.724780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-41f622d4-3dac-4416-b9c8-18da3c965e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:09.864383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f622d4-3dac-4416-b9c8-18da3c965e68 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:09.939605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf0fb5-a51f-4eb7-a0d8-1c3478e3d365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:09.940534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0fb5-a51f-4eb7-a0d8-1c3478e3d365 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:09.940993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0fb5-a51f-4eb7-a0d8-1c3478e3d365 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:09.941421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0fb5-a51f-4eb7-a0d8-1c3478e3d365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:09.943286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5dcf0fb5-a51f-4eb7-a0d8-1c3478e3d365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:10.059165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf0fb5-a51f-4eb7-a0d8-1c3478e3d365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:10.060875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf0fb5-a51f-4eb7-a0d8-1c3478e3d365 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:10.080961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 667/1311] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:12.678826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be81a55-fb06-4b42-b203-4cd17621c801 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:12.679365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be81a55-fb06-4b42-b203-4cd17621c801 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:12.679461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be81a55-fb06-4b42-b203-4cd17621c801 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:12.680778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 645/1312] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:12.686009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee470d-9975-44e1-8c24-e85e36e9fa36 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:12.686425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee470d-9975-44e1-8c24-e85e36e9fa36 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:12.686554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee470d-9975-44e1-8c24-e85e36e9fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:12.756140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9fee470d-9975-44e1-8c24-e85e36e9fa36 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:12.757320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9fee470d-9975-44e1-8c24-e85e36e9fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:12.850310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 668/1313] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:49:12.887865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be81a55-fb06-4b42-b203-4cd17621c801 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:12.889398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0be81a55-fb06-4b42-b203-4cd17621c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:12.991831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be81a55-fb06-4b42-b203-4cd17621c801 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:13.062872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f01b67-c2f8-418a-b2c8-6e9355882500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:13.063734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f01b67-c2f8-418a-b2c8-6e9355882500 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:13.064015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f01b67-c2f8-418a-b2c8-6e9355882500 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:13.064285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f01b67-c2f8-418a-b2c8-6e9355882500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:13.065930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-43f01b67-c2f8-418a-b2c8-6e9355882500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:13.170577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f01b67-c2f8-418a-b2c8-6e9355882500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:13.172047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f01b67-c2f8-418a-b2c8-6e9355882500 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:13.190128 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 646/1314] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:15.712396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6809-d0fb-4de1-b901-9dc7c315a212 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:15.712928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6809-d0fb-4de1-b901-9dc7c315a212 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:15.712928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6809-d0fb-4de1-b901-9dc7c315a212 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:15.714303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 669/1315] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:15.721790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951a8e-3678-49f7-a979-cdca25dc231e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:15.722192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951a8e-3678-49f7-a979-cdca25dc231e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:15.722343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951a8e-3678-49f7-a979-cdca25dc231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:15.794713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9c951a8e-3678-49f7-a979-cdca25dc231e None None] MFA Rules not processed for user `7d4b065be8d84f7a92ccbfe9cd4d3af3`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:15.795950 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9c951a8e-3678-49f7-a979-cdca25dc231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:15.897959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 647/1316] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:15.936790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e6809-d0fb-4de1-b901-9dc7c315a212 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:15.938315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e84e6809-d0fb-4de1-b901-9dc7c315a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:16.038650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e6809-d0fb-4de1-b901-9dc7c315a212 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:16.108905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126c4dd-dfff-472f-84f9-574c5c22f7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:16.109543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126c4dd-dfff-472f-84f9-574c5c22f7dc service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:16.109823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126c4dd-dfff-472f-84f9-574c5c22f7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:16.110092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126c4dd-dfff-472f-84f9-574c5c22f7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:16.111759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a126c4dd-dfff-472f-84f9-574c5c22f7dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:16.215357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126c4dd-dfff-472f-84f9-574c5c22f7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:16.216801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126c4dd-dfff-472f-84f9-574c5c22f7dc service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:16.234855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 670/1317] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:18.969811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772195-9b9b-44ff-b59c-c9fe396840f9 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:18.970413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772195-9b9b-44ff-b59c-c9fe396840f9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:18.970413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772195-9b9b-44ff-b59c-c9fe396840f9 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:18.971752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 648/1318] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:18.977049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75dcd3-1de8-426f-839e-5d26c820e867 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:18.977472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75dcd3-1de8-426f-839e-5d26c820e867 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:18.977572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75dcd3-1de8-426f-839e-5d26c820e867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:19.039555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-ee75dcd3-1de8-426f-839e-5d26c820e867 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:19.040736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ee75dcd3-1de8-426f-839e-5d26c820e867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:19.135395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 671/1319] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:19.173572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b772195-9b9b-44ff-b59c-c9fe396840f9 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:19.175102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9b772195-9b9b-44ff-b59c-c9fe396840f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:19.283085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b772195-9b9b-44ff-b59c-c9fe396840f9 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:19.352679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a369f-be58-45a4-8724-68754ad7a725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:19.353305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a369f-be58-45a4-8724-68754ad7a725 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:19.353576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a369f-be58-45a4-8724-68754ad7a725 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:19.353839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a369f-be58-45a4-8724-68754ad7a725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:19.356027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b97a369f-be58-45a4-8724-68754ad7a725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:19.461803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a369f-be58-45a4-8724-68754ad7a725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:19.463236 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a369f-be58-45a4-8724-68754ad7a725 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:19.483438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 649/1320] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:22.386325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d2d0-e155-4b4c-b607-47562142829f None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:22.386920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d2d0-e155-4b4c-b607-47562142829f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:22.386920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d2d0-e155-4b4c-b607-47562142829f None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:22.388335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 672/1321] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:22.393622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaccda-10c4-4147-961d-0b51154b2fad None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:22.394069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaccda-10c4-4147-961d-0b51154b2fad None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:22.394294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaccda-10c4-4147-961d-0b51154b2fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:22.457673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7adaccda-10c4-4147-961d-0b51154b2fad None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:22.458799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7adaccda-10c4-4147-961d-0b51154b2fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:22.552654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 650/1322] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:22.588168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d2d0-e155-4b4c-b607-47562142829f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:22.589716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6605d2d0-e155-4b4c-b607-47562142829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:22.691307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d2d0-e155-4b4c-b607-47562142829f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:22.764872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717d23c-d468-4381-94b1-011ee9afe718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:22.765437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d23c-d468-4381-94b1-011ee9afe718 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:22.765720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d23c-d468-4381-94b1-011ee9afe718 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:22.765993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d23c-d468-4381-94b1-011ee9afe718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:22.767660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4717d23c-d468-4381-94b1-011ee9afe718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:22.877488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717d23c-d468-4381-94b1-011ee9afe718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:22.879763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717d23c-d468-4381-94b1-011ee9afe718 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:22.901058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 673/1323] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:25.192180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd6fa-46ea-4d13-95ef-0f7fc3f0231b None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:25.192760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd6fa-46ea-4d13-95ef-0f7fc3f0231b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:25.192760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dd6fa-46ea-4d13-95ef-0f7fc3f0231b None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:25.194255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 651/1324] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:25.200587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a2543-4d6b-4f7b-b8e2-d89b67767af3 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:25.201060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a2543-4d6b-4f7b-b8e2-d89b67767af3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:25.201168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a2543-4d6b-4f7b-b8e2-d89b67767af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:25.265306 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-772a2543-4d6b-4f7b-b8e2-d89b67767af3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:25.266501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-772a2543-4d6b-4f7b-b8e2-d89b67767af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:25.363919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 674/1325] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:25.415766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c212e-2bd4-40cd-aa33-8eda08e75f78 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:25.416055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c212e-2bd4-40cd-aa33-8eda08e75f78 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:25.416345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c212e-2bd4-40cd-aa33-8eda08e75f78 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:25.417726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 652/1326] 10.222.0.93 () {54 vars in 964 bytes} [Wed May 11 18:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:25.424060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a108e-5538-49af-87ca-b0f4328f7e6f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:25.424351 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a108e-5538-49af-87ca-b0f4328f7e6f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:25.424624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a108e-5538-49af-87ca-b0f4328f7e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:25.498372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c33a108e-5538-49af-87ca-b0f4328f7e6f None None] MFA Rules not processed for user `af0204b62913420a90303c42dbded7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:25.499511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c33a108e-5538-49af-87ca-b0f4328f7e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:25.573347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 675/1327] 10.222.0.93 () {58 vars in 1061 bytes} [Wed May 11 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:25.583047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c212e-2bd4-40cd-aa33-8eda08e75f78 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:25.584618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-cd5c212e-2bd4-40cd-aa33-8eda08e75f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:25.683916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c212e-2bd4-40cd-aa33-8eda08e75f78 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:25.755972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442f379-9be4-4206-9c1b-bfd59c9a3713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:25.756538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f379-9be4-4206-9c1b-bfd59c9a3713 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:25.756818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f379-9be4-4206-9c1b-bfd59c9a3713 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:25.757085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f379-9be4-4206-9c1b-bfd59c9a3713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:25.758722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8442f379-9be4-4206-9c1b-bfd59c9a3713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:25.865813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442f379-9be4-4206-9c1b-bfd59c9a3713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:25.867254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442f379-9be4-4206-9c1b-bfd59c9a3713 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:25.888398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 653/1328] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:28.404186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03260e7-88ef-4524-9060-9224360ab67a None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:28.404760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03260e7-88ef-4524-9060-9224360ab67a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:28.404760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03260e7-88ef-4524-9060-9224360ab67a None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:28.406100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 676/1329] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:28.411310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca1452-d07d-44b9-8b6c-25a710cc96ed None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:28.411745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca1452-d07d-44b9-8b6c-25a710cc96ed None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:28.411866 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca1452-d07d-44b9-8b6c-25a710cc96ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:28.474696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-efca1452-d07d-44b9-8b6c-25a710cc96ed None None] MFA Rules not processed for user `7d4b065be8d84f7a92ccbfe9cd4d3af3`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:28.475853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-efca1452-d07d-44b9-8b6c-25a710cc96ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:28.569047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 654/1330] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:28.606406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03260e7-88ef-4524-9060-9224360ab67a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:28.607950 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a03260e7-88ef-4524-9060-9224360ab67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:28.706734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03260e7-88ef-4524-9060-9224360ab67a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:28.777833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653d6f-c27c-48c6-a1e0-04edd1a642bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:28.778501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653d6f-c27c-48c6-a1e0-04edd1a642bd service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:28.778849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653d6f-c27c-48c6-a1e0-04edd1a642bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:28.779129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653d6f-c27c-48c6-a1e0-04edd1a642bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:28.780813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-65653d6f-c27c-48c6-a1e0-04edd1a642bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:28.885354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653d6f-c27c-48c6-a1e0-04edd1a642bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:28.887394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653d6f-c27c-48c6-a1e0-04edd1a642bd service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:28.905453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 677/1331] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:31.376442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad97af-6877-4682-b890-c259b8877272 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:31.376967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad97af-6877-4682-b890-c259b8877272 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:31.376967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad97af-6877-4682-b890-c259b8877272 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:31.378637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 655/1332] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:31.384753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b871be-7748-4aae-b6ec-eaf9c67749bc None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:31.385268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b871be-7748-4aae-b6ec-eaf9c67749bc None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:31.385446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b871be-7748-4aae-b6ec-eaf9c67749bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:31.452880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c7b871be-7748-4aae-b6ec-eaf9c67749bc None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:31.454134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c7b871be-7748-4aae-b6ec-eaf9c67749bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:31.560102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 678/1333] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:31.596330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad97af-6877-4682-b890-c259b8877272 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:31.597884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bbad97af-6877-4682-b890-c259b8877272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:31.703602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad97af-6877-4682-b890-c259b8877272 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:31.775799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e073c6-a2c8-4bd2-903a-0223bce30e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:31.776445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e073c6-a2c8-4bd2-903a-0223bce30e5f service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:31.776727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e073c6-a2c8-4bd2-903a-0223bce30e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:31.776999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e073c6-a2c8-4bd2-903a-0223bce30e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:31.778663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-39e073c6-a2c8-4bd2-903a-0223bce30e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:31.883848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e073c6-a2c8-4bd2-903a-0223bce30e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:31.885294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e073c6-a2c8-4bd2-903a-0223bce30e5f service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:31.903320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 656/1334] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:34.148452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c780aa-20bd-4e7d-b904-c96a9cc86545 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:34.149011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c780aa-20bd-4e7d-b904-c96a9cc86545 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:34.149011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c780aa-20bd-4e7d-b904-c96a9cc86545 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:34.150383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 679/1335] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:34.156373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d6f7-243f-4e36-bc67-6a5b950f99d4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:34.156775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d6f7-243f-4e36-bc67-6a5b950f99d4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:34.156930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d6f7-243f-4e36-bc67-6a5b950f99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:34.220596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-74b6d6f7-243f-4e36-bc67-6a5b950f99d4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:34.221789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-74b6d6f7-243f-4e36-bc67-6a5b950f99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:34.312289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 657/1336] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:34.351767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c780aa-20bd-4e7d-b904-c96a9cc86545 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:34.353291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b1c780aa-20bd-4e7d-b904-c96a9cc86545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:34.453470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c780aa-20bd-4e7d-b904-c96a9cc86545 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:34.522908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11994a23-048e-4470-8db1-e824eff52ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:34.523582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994a23-048e-4470-8db1-e824eff52ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:34.523863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994a23-048e-4470-8db1-e824eff52ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:34.524132 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11994a23-048e-4470-8db1-e824eff52ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:34.525756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-11994a23-048e-4470-8db1-e824eff52ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:34.635008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11994a23-048e-4470-8db1-e824eff52ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:34.636485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11994a23-048e-4470-8db1-e824eff52ae8 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:34.655049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 680/1337] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:37.482187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422650-eec0-4eb5-b304-4870c2f06940 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:37.482731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422650-eec0-4eb5-b304-4870c2f06940 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:37.482731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422650-eec0-4eb5-b304-4870c2f06940 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:37.484045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 658/1338] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:37.489126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c217-0625-4cc3-87dd-18748e33b33d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:37.489503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c217-0625-4cc3-87dd-18748e33b33d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:37.489672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c217-0625-4cc3-87dd-18748e33b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:37.551959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-1bd2c217-0625-4cc3-87dd-18748e33b33d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:37.553161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1bd2c217-0625-4cc3-87dd-18748e33b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:37.645313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 681/1339] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:37.681458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422650-eec0-4eb5-b304-4870c2f06940 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:37.683019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-14422650-eec0-4eb5-b304-4870c2f06940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:37.783935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422650-eec0-4eb5-b304-4870c2f06940 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:37.855936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a83dda-24c5-42fd-a87c-283ac2f6195a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:37.856590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a83dda-24c5-42fd-a87c-283ac2f6195a service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:37.856868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a83dda-24c5-42fd-a87c-283ac2f6195a service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:37.857137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a83dda-24c5-42fd-a87c-283ac2f6195a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:37.858762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f6a83dda-24c5-42fd-a87c-283ac2f6195a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:37.962758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a83dda-24c5-42fd-a87c-283ac2f6195a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:37.964219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a83dda-24c5-42fd-a87c-283ac2f6195a service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:37.982429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 659/1340] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:42.287840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cb70-1d0f-4bad-aac6-6117adba589c None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:42.288395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cb70-1d0f-4bad-aac6-6117adba589c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:42.288395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cb70-1d0f-4bad-aac6-6117adba589c None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:42.289795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 682/1341] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:42.295835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416e31-1bbb-4e8c-abe7-81505dc82cf2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:42.296245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416e31-1bbb-4e8c-abe7-81505dc82cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:42.296380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416e31-1bbb-4e8c-abe7-81505dc82cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:42.364866 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-96416e31-1bbb-4e8c-abe7-81505dc82cf2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:42.365948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-96416e31-1bbb-4e8c-abe7-81505dc82cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:42.467152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 660/1342] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:42.504983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cb70-1d0f-4bad-aac6-6117adba589c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:42.507205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2527cb70-1d0f-4bad-aac6-6117adba589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:42.601226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cb70-1d0f-4bad-aac6-6117adba589c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:42.604814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d8dfc-7dd3-46f2-a49b-a4034f3e02b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:42.606105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8dfc-7dd3-46f2-a49b-a4034f3e02b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:42.606354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8dfc-7dd3-46f2-a49b-a4034f3e02b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:42.606622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8dfc-7dd3-46f2-a49b-a4034f3e02b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:42.616543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d8dfc-7dd3-46f2-a49b-a4034f3e02b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:42.618280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d8dfc-7dd3-46f2-a49b-a4034f3e02b3 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:42.627834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 683/1343] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:45.488914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df66448-dab6-4873-805e-56c683f27f54 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:45.489421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df66448-dab6-4873-805e-56c683f27f54 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:45.489421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df66448-dab6-4873-805e-56c683f27f54 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:45.490733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 661/1344] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:45.495925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d142f-d6e6-4b71-acc6-d250b1edc8b1 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:45.496351 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d142f-d6e6-4b71-acc6-d250b1edc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:45.496458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d142f-d6e6-4b71-acc6-d250b1edc8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:45.522950 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e75d142f-d6e6-4b71-acc6-d250b1edc8b1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:45.524161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e75d142f-d6e6-4b71-acc6-d250b1edc8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:45.598201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 684/1345] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:45.634815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df66448-dab6-4873-805e-56c683f27f54 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:45.637093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4df66448-dab6-4873-805e-56c683f27f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:45.649893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df66448-dab6-4873-805e-56c683f27f54 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:45.653998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff092ec2-d722-40fa-8bb2-0dc60b9b6aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:45.654699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092ec2-d722-40fa-8bb2-0dc60b9b6aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:45.655047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092ec2-d722-40fa-8bb2-0dc60b9b6aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:45.655425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092ec2-d722-40fa-8bb2-0dc60b9b6aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:45.664508 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff092ec2-d722-40fa-8bb2-0dc60b9b6aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:45.666011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff092ec2-d722-40fa-8bb2-0dc60b9b6aa4 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:45.675997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 662/1346] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:50.103150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6543df-40ee-4cc9-93a5-868b444cd9d1 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:50.103758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6543df-40ee-4cc9-93a5-868b444cd9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:50.103758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6543df-40ee-4cc9-93a5-868b444cd9d1 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:50.105101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 685/1347] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:50.110996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251b7e-de3d-4d8e-a3d5-322b0b9d73db None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:50.111439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251b7e-de3d-4d8e-a3d5-322b0b9d73db None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:50.111707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251b7e-de3d-4d8e-a3d5-322b0b9d73db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:50.129768 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-db251b7e-de3d-4d8e-a3d5-322b0b9d73db None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:50.130956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-db251b7e-de3d-4d8e-a3d5-322b0b9d73db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:50.138765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 663/1348] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:49:50.176054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6543df-40ee-4cc9-93a5-868b444cd9d1 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:49:50.187184 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6543df-40ee-4cc9-93a5-868b444cd9d1 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:49:50.190963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17097af-2b08-4365-93e8-51eb6fba111e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:49:50.191623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17097af-2b08-4365-93e8-51eb6fba111e service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:50.191905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17097af-2b08-4365-93e8-51eb6fba111e service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:50.192182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17097af-2b08-4365-93e8-51eb6fba111e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:50.208008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17097af-2b08-4365-93e8-51eb6fba111e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:49:50.209522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17097af-2b08-4365-93e8-51eb6fba111e service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:49:50.219174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 686/1349] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:49:55.617378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c6f3-bf16-4ee6-a924-6fa8246bfbaf None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:55.618215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c6f3-bf16-4ee6-a924-6fa8246bfbaf None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:55.618640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c6f3-bf16-4ee6-a924-6fa8246bfbaf None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:55.620590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 664/1350] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 18:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:49:55.626685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b185-03d0-4f90-90ef-15b2b6e8511a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:49:55.627577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b185-03d0-4f90-90ef-15b2b6e8511a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:49:55.628863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b185-03d0-4f90-90ef-15b2b6e8511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:49:55.726113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a9b8b185-03d0-4f90-90ef-15b2b6e8511a None None] MFA Rules not processed for user `911d21a666844fc399286e24c2892184`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:49:55.727569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a9b8b185-03d0-4f90-90ef-15b2b6e8511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:49:55.848895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 687/1351] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 18:49:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:00.004311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28640e8-3b47-4633-bc0d-b9f173045662 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:00.005187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28640e8-3b47-4633-bc0d-b9f173045662 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:00.005457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28640e8-3b47-4633-bc0d-b9f173045662 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:00.007005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 665/1352] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 18:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:00.012700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b184a-6bfb-46e0-ac04-83702d83ef27 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:00.013173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b184a-6bfb-46e0-ac04-83702d83ef27 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:00.013261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b184a-6bfb-46e0-ac04-83702d83ef27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:00.032219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-4c2b184a-6bfb-46e0-ac04-83702d83ef27 None None] MFA Rules not processed for user `911d21a666844fc399286e24c2892184`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:00.033523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4c2b184a-6bfb-46e0-ac04-83702d83ef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:00.042270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 688/1353] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 18:50:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:01.489360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce626e-684b-4328-b8fb-e77a7b08ec2d None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:01.489854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce626e-684b-4328-b8fb-e77a7b08ec2d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:01.489854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce626e-684b-4328-b8fb-e77a7b08ec2d None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:01.491427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 666/1354] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 18:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:01.496964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707064e-62aa-4367-aa0c-4cfa8ad0cbe5 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:01.497441 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707064e-62aa-4367-aa0c-4cfa8ad0cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:01.497549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707064e-62aa-4367-aa0c-4cfa8ad0cbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:01.515513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8707064e-62aa-4367-aa0c-4cfa8ad0cbe5 None None] MFA Rules not processed for user `911d21a666844fc399286e24c2892184`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:01.516686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8707064e-62aa-4367-aa0c-4cfa8ad0cbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:01.525015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 689/1355] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 18:50:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:50:05.486380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d885-c9a9-4e25-8557-812d8d7e3f2a None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:05.486934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d885-c9a9-4e25-8557-812d8d7e3f2a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:05.486934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d885-c9a9-4e25-8557-812d8d7e3f2a None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:05.488309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 667/1356] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:05.493682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f06505-e0e2-433c-8f0f-8db46aa5586a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:05.494131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f06505-e0e2-433c-8f0f-8db46aa5586a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:05.494281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f06505-e0e2-433c-8f0f-8db46aa5586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:05.512518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-34f06505-e0e2-433c-8f0f-8db46aa5586a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:05.513911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-34f06505-e0e2-433c-8f0f-8db46aa5586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:05.522648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 690/1357] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:50:05.572655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aed94-d1fe-46ae-adff-bf84a497e22b None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:05.572655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aed94-d1fe-46ae-adff-bf84a497e22b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:05.572655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aed94-d1fe-46ae-adff-bf84a497e22b None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:05.573109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 668/1358] 10.222.0.93 () {54 vars in 961 bytes} [Wed May 11 18:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:05.578887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812be710-8853-449b-b71e-0ace6b3fa372 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:05.579182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812be710-8853-449b-b71e-0ace6b3fa372 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:05.579501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812be710-8853-449b-b71e-0ace6b3fa372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:05.629926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-812be710-8853-449b-b71e-0ace6b3fa372 None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:05.631240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-812be710-8853-449b-b71e-0ace6b3fa372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:05.715587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 691/1359] 10.222.0.93 () {58 vars in 1058 bytes} [Wed May 11 18:50:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:05.724508 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80aed94-d1fe-46ae-adff-bf84a497e22b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:05.739073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80aed94-d1fe-46ae-adff-bf84a497e22b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:05.744511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73452033-5a58-466b-94ea-2ade342be38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:05.745141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73452033-5a58-466b-94ea-2ade342be38a service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:05.745416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73452033-5a58-466b-94ea-2ade342be38a service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:05.745682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73452033-5a58-466b-94ea-2ade342be38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:05.753970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73452033-5a58-466b-94ea-2ade342be38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:05.755580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73452033-5a58-466b-94ea-2ade342be38a service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:05.766838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 669/1360] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:08.235081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c73c5-2520-42b4-a6df-2fa60f988598 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:08.235628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c73c5-2520-42b4-a6df-2fa60f988598 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:08.235708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c73c5-2520-42b4-a6df-2fa60f988598 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:08.237154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 692/1361] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:08.242194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9cea-e2d9-40b1-9af5-afc3472dc806 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:08.242589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9cea-e2d9-40b1-9af5-afc3472dc806 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:08.242732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9cea-e2d9-40b1-9af5-afc3472dc806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:08.260831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4aea9cea-e2d9-40b1-9af5-afc3472dc806 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:08.262027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4aea9cea-e2d9-40b1-9af5-afc3472dc806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:08.269893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 670/1362] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:08.315384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c73c5-2520-42b4-a6df-2fa60f988598 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:08.329477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c73c5-2520-42b4-a6df-2fa60f988598 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:08.334976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61ef34-d045-4fda-9c9b-667c24840537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:08.335637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ef34-d045-4fda-9c9b-667c24840537 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:08.335915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ef34-d045-4fda-9c9b-667c24840537 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:08.336185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ef34-d045-4fda-9c9b-667c24840537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:08.344402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ef34-d045-4fda-9c9b-667c24840537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:08.345984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ef34-d045-4fda-9c9b-667c24840537 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:08.356131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 693/1363] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:10.877415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97437c7b-33bd-4426-8347-d448e1972975 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:10.877876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97437c7b-33bd-4426-8347-d448e1972975 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:10.877966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97437c7b-33bd-4426-8347-d448e1972975 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:10.879335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 671/1364] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:10.884515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4d21b-af1b-4937-961e-2a2adbc6baf8 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:10.884933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4d21b-af1b-4937-961e-2a2adbc6baf8 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:10.885109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4d21b-af1b-4937-961e-2a2adbc6baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:10.904566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a4c4d21b-af1b-4937-961e-2a2adbc6baf8 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:10.905758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a4c4d21b-af1b-4937-961e-2a2adbc6baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:10.913581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 694/1365] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:10.960232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b7d60-719d-42f1-8800-d31b761394a9 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:10.960518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b7d60-719d-42f1-8800-d31b761394a9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:10.960794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b7d60-719d-42f1-8800-d31b761394a9 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:10.962212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 672/1366] 10.222.0.93 () {54 vars in 961 bytes} [Wed May 11 18:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:10.968438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c09069-f882-476b-9f7b-dacbafdaab43 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:10.968770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c09069-f882-476b-9f7b-dacbafdaab43 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:10.968991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c09069-f882-476b-9f7b-dacbafdaab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:10.987925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-60c09069-f882-476b-9f7b-dacbafdaab43 None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:10.989101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-60c09069-f882-476b-9f7b-dacbafdaab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:10.998150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 695/1367] 10.222.0.93 () {58 vars in 1058 bytes} [Wed May 11 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:50:11.005816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b7d60-719d-42f1-8800-d31b761394a9 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:11.019491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b7d60-719d-42f1-8800-d31b761394a9 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:11.024720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f89a0-70bb-4adb-a7df-c542bffb633b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:11.025331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f89a0-70bb-4adb-a7df-c542bffb633b service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:11.025605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f89a0-70bb-4adb-a7df-c542bffb633b service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:11.025874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f89a0-70bb-4adb-a7df-c542bffb633b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:11.034231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f89a0-70bb-4adb-a7df-c542bffb633b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:11.035808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f89a0-70bb-4adb-a7df-c542bffb633b service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:11.045426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 673/1368] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:13.307939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074f1c-b599-444c-8aea-17329454145d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:13.308840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074f1c-b599-444c-8aea-17329454145d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:13.309153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64074f1c-b599-444c-8aea-17329454145d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:13.310549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 696/1369] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:13.316361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489de9a-43e2-48d8-8774-752838bacce5 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:13.316812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489de9a-43e2-48d8-8774-752838bacce5 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:13.316892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489de9a-43e2-48d8-8774-752838bacce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:13.334183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-3489de9a-43e2-48d8-8774-752838bacce5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:13.335541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3489de9a-43e2-48d8-8774-752838bacce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:13.343946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 674/1370] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:13.387608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64074f1c-b599-444c-8aea-17329454145d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:13.401791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64074f1c-b599-444c-8aea-17329454145d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:13.407844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c916f4f-1fdc-42fe-afec-ab327f76a8ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:13.408484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916f4f-1fdc-42fe-afec-ab327f76a8ed service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:13.408762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916f4f-1fdc-42fe-afec-ab327f76a8ed service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:13.409032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916f4f-1fdc-42fe-afec-ab327f76a8ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:13.417618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916f4f-1fdc-42fe-afec-ab327f76a8ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:13.419219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916f4f-1fdc-42fe-afec-ab327f76a8ed service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:13.428622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 697/1371] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:13.765839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8add-3c00-4e67-9ee5-429c2cd03f48 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:13.766037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8add-3c00-4e67-9ee5-429c2cd03f48 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:13.766303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8add-3c00-4e67-9ee5-429c2cd03f48 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:13.768160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 675/1372] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:13.773382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734f94-6058-4be2-a246-5fb5e0b7d7f6 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:13.773677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734f94-6058-4be2-a246-5fb5e0b7d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:13.773954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d734f94-6058-4be2-a246-5fb5e0b7d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:13.791404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7d734f94-6058-4be2-a246-5fb5e0b7d7f6 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:13.792603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7d734f94-6058-4be2-a246-5fb5e0b7d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:13.800589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 698/1373] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:14.155210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536ff60-e99a-4dc6-bb6e-01fd8116dba8 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:14.155642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536ff60-e99a-4dc6-bb6e-01fd8116dba8 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:14.156019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536ff60-e99a-4dc6-bb6e-01fd8116dba8 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:14.157495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 676/1374] 10.222.0.93 () {54 vars in 963 bytes} [Wed May 11 18:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:14.164321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495397a6-4d79-45a3-b78b-e50f60e1828c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:14.164609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495397a6-4d79-45a3-b78b-e50f60e1828c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:14.165527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495397a6-4d79-45a3-b78b-e50f60e1828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:14.232637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-495397a6-4d79-45a3-b78b-e50f60e1828c None None] MFA Rules not processed for user `ae471a0d19b04d1daf634d6d2c73645a`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:14.234148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-495397a6-4d79-45a3-b78b-e50f60e1828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:14.318582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 699/1375] 10.222.0.93 () {58 vars in 1060 bytes} [Wed May 11 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:14.327037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536ff60-e99a-4dc6-bb6e-01fd8116dba8 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:14.339979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536ff60-e99a-4dc6-bb6e-01fd8116dba8 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:14.344212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4831560-120a-4346-81a0-db0eb7c6cc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:14.345079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4831560-120a-4346-81a0-db0eb7c6cc6f service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:14.345590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4831560-120a-4346-81a0-db0eb7c6cc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:14.346054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4831560-120a-4346-81a0-db0eb7c6cc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:14.358334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4831560-120a-4346-81a0-db0eb7c6cc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:14.360311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4831560-120a-4346-81a0-db0eb7c6cc6f service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:14.389630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 677/1376] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:50:15.734124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4b0c-a834-48f5-86e9-23aa6b222c6b None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:15.734694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4b0c-a834-48f5-86e9-23aa6b222c6b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:15.734694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4b0c-a834-48f5-86e9-23aa6b222c6b None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:15.736060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 700/1377] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:15.741351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09ff8-3355-4666-a1ed-a6036fb65f80 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:15.741766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09ff8-3355-4666-a1ed-a6036fb65f80 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:15.741934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09ff8-3355-4666-a1ed-a6036fb65f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:15.760473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-71a09ff8-3355-4666-a1ed-a6036fb65f80 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:15.761715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-71a09ff8-3355-4666-a1ed-a6036fb65f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:15.769399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 678/1378] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:15.813509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4b0c-a834-48f5-86e9-23aa6b222c6b None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:15.827733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4b0c-a834-48f5-86e9-23aa6b222c6b None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:15.833128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19d4cd-468e-4fff-9b32-33e6e882edd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:15.833758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d4cd-468e-4fff-9b32-33e6e882edd8 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:15.834037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d4cd-468e-4fff-9b32-33e6e882edd8 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:15.834308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d4cd-468e-4fff-9b32-33e6e882edd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:15.842302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19d4cd-468e-4fff-9b32-33e6e882edd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:15.843916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19d4cd-468e-4fff-9b32-33e6e882edd8 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:15.853136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 701/1379] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:18.140525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbd07-b07b-4ca9-81ab-d7fef8e55b00 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:18.141035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbd07-b07b-4ca9-81ab-d7fef8e55b00 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:18.141035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbd07-b07b-4ca9-81ab-d7fef8e55b00 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:18.142569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 679/1380] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:18.147765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f61a6-f87a-4ec9-8d78-78aefa77c2cf None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:18.148158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f61a6-f87a-4ec9-8d78-78aefa77c2cf None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:18.148312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f61a6-f87a-4ec9-8d78-78aefa77c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:18.166496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-069f61a6-f87a-4ec9-8d78-78aefa77c2cf None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:18.168185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-069f61a6-f87a-4ec9-8d78-78aefa77c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:18.180289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 702/1381] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:18.225466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cbd07-b07b-4ca9-81ab-d7fef8e55b00 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:18.240937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cbd07-b07b-4ca9-81ab-d7fef8e55b00 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:18.247116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc284fb-fc17-4849-bb30-59231fe429e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:18.247932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc284fb-fc17-4849-bb30-59231fe429e7 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:18.248330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc284fb-fc17-4849-bb30-59231fe429e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:18.248833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc284fb-fc17-4849-bb30-59231fe429e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:18.257308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc284fb-fc17-4849-bb30-59231fe429e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:18.259124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc284fb-fc17-4849-bb30-59231fe429e7 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:18.269967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 680/1382] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:20.533787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791434d6-f052-4f5c-985c-fe53d92b792d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:20.534575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791434d6-f052-4f5c-985c-fe53d92b792d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:20.534575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791434d6-f052-4f5c-985c-fe53d92b792d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:20.535687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 703/1383] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:20.540887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4526fc-0e8d-4273-b2ec-e15f3763d7a1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:20.541399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4526fc-0e8d-4273-b2ec-e15f3763d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:20.541577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4526fc-0e8d-4273-b2ec-e15f3763d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:20.559240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-8e4526fc-0e8d-4273-b2ec-e15f3763d7a1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:20.560436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8e4526fc-0e8d-4273-b2ec-e15f3763d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:20.569546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 681/1384] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:50:20.612282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791434d6-f052-4f5c-985c-fe53d92b792d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:20.626951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791434d6-f052-4f5c-985c-fe53d92b792d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:20.632648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2894c9-18b3-4f7b-8d97-517d85412f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:20.633389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2894c9-18b3-4f7b-8d97-517d85412f81 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:20.633740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2894c9-18b3-4f7b-8d97-517d85412f81 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:20.634084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2894c9-18b3-4f7b-8d97-517d85412f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:20.642761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2894c9-18b3-4f7b-8d97-517d85412f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:20.644451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2894c9-18b3-4f7b-8d97-517d85412f81 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:20.654980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 704/1385] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:23.040001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ac64-1116-443b-9c32-1d9878bccfdb None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:23.040547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ac64-1116-443b-9c32-1d9878bccfdb None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:23.040630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ac64-1116-443b-9c32-1d9878bccfdb None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:23.042053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 682/1386] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:23.048657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ca2a-aaf2-449a-bee4-69e852ec3b7b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:23.049128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ca2a-aaf2-449a-bee4-69e852ec3b7b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:23.049396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ca2a-aaf2-449a-bee4-69e852ec3b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:23.071533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-cf78ca2a-aaf2-449a-bee4-69e852ec3b7b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:23.073034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-cf78ca2a-aaf2-449a-bee4-69e852ec3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:23.083028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 705/1387] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:23.131845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65ac64-1116-443b-9c32-1d9878bccfdb None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:23.147802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65ac64-1116-443b-9c32-1d9878bccfdb None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:23.154776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a4f19-a219-422f-b2f6-d5c6f4c91348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:23.155649 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a4f19-a219-422f-b2f6-d5c6f4c91348 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:23.155999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a4f19-a219-422f-b2f6-d5c6f4c91348 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:23.156334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a4f19-a219-422f-b2f6-d5c6f4c91348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:23.166414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a4f19-a219-422f-b2f6-d5c6f4c91348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:23.168426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a4f19-a219-422f-b2f6-d5c6f4c91348 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:23.180131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 683/1388] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:25.804056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d67b-5c66-4885-a1ee-c2899ff331b0 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:25.804645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d67b-5c66-4885-a1ee-c2899ff331b0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:25.804645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d67b-5c66-4885-a1ee-c2899ff331b0 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:25.806065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 706/1389] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:25.812166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321dc48-0901-4fab-9290-4b169e462711 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:25.812632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321dc48-0901-4fab-9290-4b169e462711 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:25.812731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321dc48-0901-4fab-9290-4b169e462711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:25.831847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c321dc48-0901-4fab-9290-4b169e462711 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:25.833111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c321dc48-0901-4fab-9290-4b169e462711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:25.841633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 684/1390] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:25.885128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d67b-5c66-4885-a1ee-c2899ff331b0 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:25.900597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d67b-5c66-4885-a1ee-c2899ff331b0 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:25.906159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfafaa-a72b-4bff-b043-448783c53888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:25.906855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfafaa-a72b-4bff-b043-448783c53888 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:25.907106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfafaa-a72b-4bff-b043-448783c53888 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:25.907412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfafaa-a72b-4bff-b043-448783c53888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:25.915705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfafaa-a72b-4bff-b043-448783c53888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:25.917292 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfafaa-a72b-4bff-b043-448783c53888 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:25.926922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 707/1391] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:28.620699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cd680-c160-46df-a308-49c33117cb34 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:28.621263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cd680-c160-46df-a308-49c33117cb34 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:28.621263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cd680-c160-46df-a308-49c33117cb34 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:28.622530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 685/1392] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:28.627872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8a1d-e621-4c4c-804f-7109f220cd00 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:28.628296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8a1d-e621-4c4c-804f-7109f220cd00 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:28.628425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae8a1d-e621-4c4c-804f-7109f220cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:28.646707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-17ae8a1d-e621-4c4c-804f-7109f220cd00 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:28.647921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-17ae8a1d-e621-4c4c-804f-7109f220cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:28.656360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 708/1393] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:28.699834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cd680-c160-46df-a308-49c33117cb34 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:28.714326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cd680-c160-46df-a308-49c33117cb34 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:28.720388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b8b04-296b-4f67-818a-d940778de46d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:28.721022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8b04-296b-4f67-818a-d940778de46d service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:28.721302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8b04-296b-4f67-818a-d940778de46d service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:28.721694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8b04-296b-4f67-818a-d940778de46d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:28.729741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b8b04-296b-4f67-818a-d940778de46d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:28.731325 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b8b04-296b-4f67-818a-d940778de46d service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:28.740889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 686/1394] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:30.054168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33604b-2a2d-46b0-8b76-a024fa8e6b48 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:30.054741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33604b-2a2d-46b0-8b76-a024fa8e6b48 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:30.054741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33604b-2a2d-46b0-8b76-a024fa8e6b48 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:30.056249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 709/1395] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:30.061639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e95be-a8dd-41ea-bb2f-c98e2b93cbc2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:30.062044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e95be-a8dd-41ea-bb2f-c98e2b93cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:30.062187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e95be-a8dd-41ea-bb2f-c98e2b93cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:30.080237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ab6e95be-a8dd-41ea-bb2f-c98e2b93cbc2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:30.081416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ab6e95be-a8dd-41ea-bb2f-c98e2b93cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:30.089499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 687/1396] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:30.144730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3abf7-eff6-45c9-87eb-9f6b86179d36 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:30.145020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3abf7-eff6-45c9-87eb-9f6b86179d36 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:30.145296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3abf7-eff6-45c9-87eb-9f6b86179d36 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:30.146639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 710/1397] 10.222.0.93 () {54 vars in 962 bytes} [Wed May 11 18:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:30.152560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0be036-7100-41ef-9505-8ccbd583b121 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:30.152859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0be036-7100-41ef-9505-8ccbd583b121 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:30.153138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0be036-7100-41ef-9505-8ccbd583b121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:30.203201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-2c0be036-7100-41ef-9505-8ccbd583b121 None None] MFA Rules not processed for user `9a1d39dd41c348cb9cfdde6fa15da315`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:30.204457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2c0be036-7100-41ef-9505-8ccbd583b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:30.263707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 688/1398] 10.222.0.93 () {58 vars in 1059 bytes} [Wed May 11 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:30.271201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3abf7-eff6-45c9-87eb-9f6b86179d36 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:30.281525 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3abf7-eff6-45c9-87eb-9f6b86179d36 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:30.285021 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c25365-77e1-4802-aa8a-da4b79453e6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:30.285649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25365-77e1-4802-aa8a-da4b79453e6d service glance] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:30.285933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25365-77e1-4802-aa8a-da4b79453e6d service glance] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:30.286204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25365-77e1-4802-aa8a-da4b79453e6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:30.295118 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c25365-77e1-4802-aa8a-da4b79453e6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:30.296620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c25365-77e1-4802-aa8a-da4b79453e6d service glance] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:30.306191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 711/1399] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:30.727251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887094-ad92-4d58-9e30-33c85ee7db3c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:30.727656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887094-ad92-4d58-9e30-33c85ee7db3c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:30.727999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887094-ad92-4d58-9e30-33c85ee7db3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:30.776721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-48887094-ad92-4d58-9e30-33c85ee7db3c None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:30.777972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-48887094-ad92-4d58-9e30-33c85ee7db3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:30.841799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 689/1400] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:30.887945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcca99-9c78-488f-ba53-cefe8eb242a3 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:30.888308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcca99-9c78-488f-ba53-cefe8eb242a3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:30.888663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcca99-9c78-488f-ba53-cefe8eb242a3 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:30.890144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 712/1401] 10.222.0.93 () {54 vars in 942 bytes} [Wed May 11 18:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:30.896566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56926a99-6876-4531-8327-3cca583a9b89 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:30.896858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56926a99-6876-4531-8327-3cca583a9b89 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:30.897138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56926a99-6876-4531-8327-3cca583a9b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:30.945576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-56926a99-6876-4531-8327-3cca583a9b89 None None] MFA Rules not processed for user `d0583c8ab3414ff6b70acf6267ef0d25`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:30.946782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-56926a99-6876-4531-8327-3cca583a9b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:31.015535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 690/1402] 10.222.0.93 () {58 vars in 1039 bytes} [Wed May 11 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:31.018263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f12b4-5aa6-4502-96ea-c68b02b78a42 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:31.018620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f12b4-5aa6-4502-96ea-c68b02b78a42 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:31.019079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f12b4-5aa6-4502-96ea-c68b02b78a42 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:31.020573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 713/1403] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:31.024515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56926a99-6876-4531-8327-3cca583a9b89 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:31.025492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee653a-648a-4828-991c-d0ab9311f9fb None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:31.025780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee653a-648a-4828-991c-d0ab9311f9fb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:31.026058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee653a-648a-4828-991c-d0ab9311f9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:31.035077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56926a99-6876-4531-8327-3cca583a9b89 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:31.040197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60677392-e2ef-4b0a-9639-12a837def5bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:31.040835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677392-e2ef-4b0a-9639-12a837def5bd service swift] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:31.041116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677392-e2ef-4b0a-9639-12a837def5bd service swift] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:31.041447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677392-e2ef-4b0a-9639-12a837def5bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:31.044282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7aee653a-648a-4828-991c-d0ab9311f9fb None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:31.045480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7aee653a-648a-4828-991c-d0ab9311f9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:31.050227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60677392-e2ef-4b0a-9639-12a837def5bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:31.051830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60677392-e2ef-4b0a-9639-12a837def5bd service swift] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:31.053260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 714/1404] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:50:31.059987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 691/1405] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 18:50:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 18:50:31.097033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee653a-648a-4828-991c-d0ab9311f9fb None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:31.110182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee653a-648a-4828-991c-d0ab9311f9fb None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:31.115960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab85594-e45b-4d91-98da-4c50642ab6fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:31.116700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85594-e45b-4d91-98da-4c50642ab6fc service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:31.117011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85594-e45b-4d91-98da-4c50642ab6fc service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:31.117287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85594-e45b-4d91-98da-4c50642ab6fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:31.126287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85594-e45b-4d91-98da-4c50642ab6fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:31.127924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85594-e45b-4d91-98da-4c50642ab6fc service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:31.138002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 715/1406] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:33.431454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153c60-eb5e-411c-93fc-1d223f9be09d None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:33.432035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153c60-eb5e-411c-93fc-1d223f9be09d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:33.432134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153c60-eb5e-411c-93fc-1d223f9be09d None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:33.434141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 692/1407] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:33.439741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670231b-bf32-424f-a1ea-c2275d8d29dd None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:33.440169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670231b-bf32-424f-a1ea-c2275d8d29dd None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:33.440298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670231b-bf32-424f-a1ea-c2275d8d29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:33.462614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9670231b-bf32-424f-a1ea-c2275d8d29dd None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:33.464207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9670231b-bf32-424f-a1ea-c2275d8d29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:33.475701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 716/1408] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:33.520783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b153c60-eb5e-411c-93fc-1d223f9be09d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:33.535834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b153c60-eb5e-411c-93fc-1d223f9be09d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:33.541769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd89a3-e989-44ad-8843-bcd267bbeff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:33.542505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd89a3-e989-44ad-8843-bcd267bbeff6 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:33.542877 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd89a3-e989-44ad-8843-bcd267bbeff6 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:33.543213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd89a3-e989-44ad-8843-bcd267bbeff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:33.553304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd89a3-e989-44ad-8843-bcd267bbeff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:33.554980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd89a3-e989-44ad-8843-bcd267bbeff6 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:33.566117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 693/1409] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:54.152929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4ae8-820d-41da-8309-bca97e8a68ac None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:54.153567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4ae8-820d-41da-8309-bca97e8a68ac None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:54.153567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4ae8-820d-41da-8309-bca97e8a68ac None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:54.154870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 717/1410] 10.222.0.93 () {54 vars in 918 bytes} [Wed May 11 18:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:54.160309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1e1a-fdac-4703-9aa6-e5f20abcb82c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:54.160764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1e1a-fdac-4703-9aa6-e5f20abcb82c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:54.160889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1e1a-fdac-4703-9aa6-e5f20abcb82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:54.178456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-977b1e1a-fdac-4703-9aa6-e5f20abcb82c None None] MFA Rules not processed for user `911d21a666844fc399286e24c2892184`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:54.179681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-977b1e1a-fdac-4703-9aa6-e5f20abcb82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:54.188026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 694/1411] 10.222.0.93 () {58 vars in 1015 bytes} [Wed May 11 18:50:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:54.202786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491d5d-e9da-4cc5-8047-7714f7ceed29 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:54.203194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491d5d-e9da-4cc5-8047-7714f7ceed29 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:54.203566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491d5d-e9da-4cc5-8047-7714f7ceed29 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:54.204918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 718/1412] 10.222.0.93 () {54 vars in 918 bytes} [Wed May 11 18:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:54.209663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24143082-970d-4781-b7b9-8cfb4b8dcb6b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:54.209947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24143082-970d-4781-b7b9-8cfb4b8dcb6b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:54.210216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24143082-970d-4781-b7b9-8cfb4b8dcb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:54.228450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-24143082-970d-4781-b7b9-8cfb4b8dcb6b None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:54.229633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-24143082-970d-4781-b7b9-8cfb4b8dcb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:54.238708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 695/1413] 10.222.0.93 () {58 vars in 1015 bytes} [Wed May 11 18:50:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:56.946646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a3fea-1e16-4ad2-90e7-804546c550ec None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:56.947202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a3fea-1e16-4ad2-90e7-804546c550ec None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:56.947548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a3fea-1e16-4ad2-90e7-804546c550ec None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:56.949023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:56.954539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774718-789f-47d4-8f0a-054ad20ea254 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:56.954980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774718-789f-47d4-8f0a-054ad20ea254 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:56.955081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774718-789f-47d4-8f0a-054ad20ea254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:56.972449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4f774718-789f-47d4-8f0a-054ad20ea254 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:56.973664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4f774718-789f-47d4-8f0a-054ad20ea254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:56.981851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:57.022889 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a3fea-1e16-4ad2-90e7-804546c550ec None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:57.037107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a3fea-1e16-4ad2-90e7-804546c550ec None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:57.042996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797768a9-376b-4e14-99c2-96bccf72249a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:57.043658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797768a9-376b-4e14-99c2-96bccf72249a service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:57.043943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797768a9-376b-4e14-99c2-96bccf72249a service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:57.044219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797768a9-376b-4e14-99c2-96bccf72249a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:57.052129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797768a9-376b-4e14-99c2-96bccf72249a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:57.053703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797768a9-376b-4e14-99c2-96bccf72249a service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:57.063510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 720/1416] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:58.046761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b1e2-b179-407c-b1a7-2199e52c9bc0 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:58.047370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b1e2-b179-407c-b1a7-2199e52c9bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:58.047370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b1e2-b179-407c-b1a7-2199e52c9bc0 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:58.048698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:58.053543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08185-de2e-42ce-8b28-52f293731388 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:58.053997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08185-de2e-42ce-8b28-52f293731388 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:58.054121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08185-de2e-42ce-8b28-52f293731388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:58.071685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f2a08185-de2e-42ce-8b28-52f293731388 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:58.072860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f2a08185-de2e-42ce-8b28-52f293731388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:58.080439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:58.242225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b1e2-b179-407c-b1a7-2199e52c9bc0 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:58.256192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b1e2-b179-407c-b1a7-2199e52c9bc0 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:58.261493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b9dcc-538e-41b0-a1f4-6db8e892fd4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:58.262120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9dcc-538e-41b0-a1f4-6db8e892fd4d service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:58.262397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9dcc-538e-41b0-a1f4-6db8e892fd4d service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:58.262665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9dcc-538e-41b0-a1f4-6db8e892fd4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:58.270472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b9dcc-538e-41b0-a1f4-6db8e892fd4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:58.272076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b9dcc-538e-41b0-a1f4-6db8e892fd4d service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:58.281601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 698/1419] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:50:59.239151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94d19-9558-48ef-ace7-dc6d5671656a None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:59.239737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94d19-9558-48ef-ace7-dc6d5671656a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:59.239737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94d19-9558-48ef-ace7-dc6d5671656a None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:59.241145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:50:59.249073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ee1c-360c-43ec-b014-d36b0d435279 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:59.249512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ee1c-360c-43ec-b014-d36b0d435279 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:59.249606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ee1c-360c-43ec-b014-d36b0d435279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:59.269604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9eb6ee1c-360c-43ec-b014-d36b0d435279 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:50:59.270778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9eb6ee1c-360c-43ec-b014-d36b0d435279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:50:59.280741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:50:59.428505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db94d19-9558-48ef-ace7-dc6d5671656a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:50:59.442751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db94d19-9558-48ef-ace7-dc6d5671656a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:50:59.448083 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82020274-4acf-4780-961c-7a59521881a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:50:59.449226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82020274-4acf-4780-961c-7a59521881a4 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:50:59.449504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82020274-4acf-4780-961c-7a59521881a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:50:59.449777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82020274-4acf-4780-961c-7a59521881a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:50:59.457701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82020274-4acf-4780-961c-7a59521881a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:50:59.459208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82020274-4acf-4780-961c-7a59521881a4 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:50:59.469201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 723/1422] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:00.395134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124c19-7b1f-45a7-9129-8b884245870d None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:00.395694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124c19-7b1f-45a7-9129-8b884245870d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:00.395694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124c19-7b1f-45a7-9129-8b884245870d None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:00.397086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:00.402602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfeca9-6062-4316-adce-ba6418dc94b2 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:00.403030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfeca9-6062-4316-adce-ba6418dc94b2 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:00.403128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfeca9-6062-4316-adce-ba6418dc94b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:00.421492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-46dfeca9-6062-4316-adce-ba6418dc94b2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:00.422673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-46dfeca9-6062-4316-adce-ba6418dc94b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:00.430413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:51:00.583481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124c19-7b1f-45a7-9129-8b884245870d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:00.599679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124c19-7b1f-45a7-9129-8b884245870d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:00.605924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b54ed-852e-44fe-8eea-5f7a1d7cbac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:00.606599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b54ed-852e-44fe-8eea-5f7a1d7cbac9 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:00.606881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b54ed-852e-44fe-8eea-5f7a1d7cbac9 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:00.607150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b54ed-852e-44fe-8eea-5f7a1d7cbac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:00.615817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b54ed-852e-44fe-8eea-5f7a1d7cbac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:00.617396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b54ed-852e-44fe-8eea-5f7a1d7cbac9 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:00.627779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 701/1425] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:01.548497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145cf2-3ca7-4c37-a322-58aaf3dec73d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:01.549057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145cf2-3ca7-4c37-a322-58aaf3dec73d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:01.549057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145cf2-3ca7-4c37-a322-58aaf3dec73d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:01.550315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:01.555194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f75814-3311-4e2d-83b6-19da354ec6b1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:01.555610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f75814-3311-4e2d-83b6-19da354ec6b1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:01.555766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f75814-3311-4e2d-83b6-19da354ec6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:01.574629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-96f75814-3311-4e2d-83b6-19da354ec6b1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:01.575872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-96f75814-3311-4e2d-83b6-19da354ec6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:01.583805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:01.730354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7145cf2-3ca7-4c37-a322-58aaf3dec73d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:01.744366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7145cf2-3ca7-4c37-a322-58aaf3dec73d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:01.750395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4e2a9-d936-4f45-99f1-79ee74be2af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:01.751022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e2a9-d936-4f45-99f1-79ee74be2af3 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:01.751314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e2a9-d936-4f45-99f1-79ee74be2af3 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:01.751612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e2a9-d936-4f45-99f1-79ee74be2af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:01.759464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4e2a9-d936-4f45-99f1-79ee74be2af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:01.761044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4e2a9-d936-4f45-99f1-79ee74be2af3 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:01.769972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 726/1428] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:02.650355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83e90-0dc8-41c2-a63d-14af7805d6c8 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:02.650887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83e90-0dc8-41c2-a63d-14af7805d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:02.650887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83e90-0dc8-41c2-a63d-14af7805d6c8 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:02.652218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:02.656979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d013-d370-4ebc-9106-ffdaac2dd5ca None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:02.657393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d013-d370-4ebc-9106-ffdaac2dd5ca None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:02.657516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d013-d370-4ebc-9106-ffdaac2dd5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:02.675396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e565d013-d370-4ebc-9106-ffdaac2dd5ca None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:02.676591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e565d013-d370-4ebc-9106-ffdaac2dd5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:02.684787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:02.834133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b83e90-0dc8-41c2-a63d-14af7805d6c8 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:02.848154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b83e90-0dc8-41c2-a63d-14af7805d6c8 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:02.853660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2f078-37d6-47e2-8342-7277fd514247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:02.854290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2f078-37d6-47e2-8342-7277fd514247 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:02.854573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2f078-37d6-47e2-8342-7277fd514247 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:02.855404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2f078-37d6-47e2-8342-7277fd514247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:02.863534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2f078-37d6-47e2-8342-7277fd514247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:02.865098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2f078-37d6-47e2-8342-7277fd514247 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:02.874859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 704/1431] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:03.742231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b67a-4bb3-4eb8-b0ee-23512bd9e2c7 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:03.742771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b67a-4bb3-4eb8-b0ee-23512bd9e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:03.742771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b67a-4bb3-4eb8-b0ee-23512bd9e2c7 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:03.744152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:03.749926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3c666-6a0a-45a2-b9f0-ffaf6e5512f5 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:03.750351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3c666-6a0a-45a2-b9f0-ffaf6e5512f5 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:03.750473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3c666-6a0a-45a2-b9f0-ffaf6e5512f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:03.767930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-50c3c666-6a0a-45a2-b9f0-ffaf6e5512f5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:03.769114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-50c3c666-6a0a-45a2-b9f0-ffaf6e5512f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:03.776765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:03.926483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342b67a-4bb3-4eb8-b0ee-23512bd9e2c7 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:03.940981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342b67a-4bb3-4eb8-b0ee-23512bd9e2c7 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:03.946466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b385ba-da39-492d-addb-0a32ad3e2bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:03.947088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b385ba-da39-492d-addb-0a32ad3e2bbd service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:03.947400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b385ba-da39-492d-addb-0a32ad3e2bbd service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:03.947669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b385ba-da39-492d-addb-0a32ad3e2bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:03.955507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b385ba-da39-492d-addb-0a32ad3e2bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:03.957065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b385ba-da39-492d-addb-0a32ad3e2bbd service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:03.966513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 729/1434] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:04.852629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993cf34-b7cc-4c90-a22c-f935477466eb None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:04.853204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993cf34-b7cc-4c90-a22c-f935477466eb None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:04.853204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993cf34-b7cc-4c90-a22c-f935477466eb None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:04.854543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:04.861013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab88d-f31e-4426-9a11-ded8d3246f2c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:04.861513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab88d-f31e-4426-9a11-ded8d3246f2c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:04.861916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab88d-f31e-4426-9a11-ded8d3246f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:04.879675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3e4ab88d-f31e-4426-9a11-ded8d3246f2c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:04.880906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3e4ab88d-f31e-4426-9a11-ded8d3246f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:04.888818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:05.041110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993cf34-b7cc-4c90-a22c-f935477466eb None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:05.055677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993cf34-b7cc-4c90-a22c-f935477466eb None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:05.061260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eea332-89f6-4509-8b1c-b60956f22720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:05.061890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eea332-89f6-4509-8b1c-b60956f22720 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:05.062165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eea332-89f6-4509-8b1c-b60956f22720 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:05.062435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eea332-89f6-4509-8b1c-b60956f22720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:05.071607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eea332-89f6-4509-8b1c-b60956f22720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:05.073183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eea332-89f6-4509-8b1c-b60956f22720 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:05.082422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 707/1437] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:05.966044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f523ee-6d71-4340-bfc0-9b60d547f828 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:05.966645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f523ee-6d71-4340-bfc0-9b60d547f828 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:05.966645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f523ee-6d71-4340-bfc0-9b60d547f828 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:05.968001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:05.972759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33d9e-537f-45b0-bc1c-d5d379a8cdfd None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:05.973196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33d9e-537f-45b0-bc1c-d5d379a8cdfd None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:05.973328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d33d9e-537f-45b0-bc1c-d5d379a8cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:05.991606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-31d33d9e-537f-45b0-bc1c-d5d379a8cdfd None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:05.992779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-31d33d9e-537f-45b0-bc1c-d5d379a8cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:06.001103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:51:06.153353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f523ee-6d71-4340-bfc0-9b60d547f828 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:06.169345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f523ee-6d71-4340-bfc0-9b60d547f828 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:06.174815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb148577-41fc-4b11-ac0f-0560c635f545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:06.175489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb148577-41fc-4b11-ac0f-0560c635f545 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:06.175777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb148577-41fc-4b11-ac0f-0560c635f545 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:06.176051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb148577-41fc-4b11-ac0f-0560c635f545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:06.193179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb148577-41fc-4b11-ac0f-0560c635f545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:06.194763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb148577-41fc-4b11-ac0f-0560c635f545 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:06.204989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 732/1440] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:08.299886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aec385-5788-4bfe-8cdd-46882658a375 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:08.300447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aec385-5788-4bfe-8cdd-46882658a375 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:08.300447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aec385-5788-4bfe-8cdd-46882658a375 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:08.301803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:08.307185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd0b5-abca-4987-a9ea-23478781fb09 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:08.307666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd0b5-abca-4987-a9ea-23478781fb09 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:08.307889 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd0b5-abca-4987-a9ea-23478781fb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:08.325850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-125fd0b5-abca-4987-a9ea-23478781fb09 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:08.326971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-125fd0b5-abca-4987-a9ea-23478781fb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:08.334695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:08.374115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aec385-5788-4bfe-8cdd-46882658a375 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:08.385067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aec385-5788-4bfe-8cdd-46882658a375 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:08.390324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7221374-854b-442d-ab85-4e468493215b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:08.391447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221374-854b-442d-ab85-4e468493215b service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:08.391728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221374-854b-442d-ab85-4e468493215b service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:08.392000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221374-854b-442d-ab85-4e468493215b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:08.401105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7221374-854b-442d-ab85-4e468493215b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:08.402796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7221374-854b-442d-ab85-4e468493215b service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:08.412442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 710/1443] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:10.850043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cdd69-c06e-4e27-ac34-2b384c445ea2 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:10.850630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cdd69-c06e-4e27-ac34-2b384c445ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:10.850630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cdd69-c06e-4e27-ac34-2b384c445ea2 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:10.851967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:10.857682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8bd0d-0d9f-485c-9689-a3a66f450033 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:10.858065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8bd0d-0d9f-485c-9689-a3a66f450033 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:10.858233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8bd0d-0d9f-485c-9689-a3a66f450033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:10.876435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7fb8bd0d-0d9f-485c-9689-a3a66f450033 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:10.877629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7fb8bd0d-0d9f-485c-9689-a3a66f450033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:10.885448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:10.923772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cdd69-c06e-4e27-ac34-2b384c445ea2 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:10.934210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cdd69-c06e-4e27-ac34-2b384c445ea2 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:10.937895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f37ff-b9cf-4068-9c82-2b3d661987ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:10.938532 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f37ff-b9cf-4068-9c82-2b3d661987ae service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:10.938814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f37ff-b9cf-4068-9c82-2b3d661987ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:10.939088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f37ff-b9cf-4068-9c82-2b3d661987ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:10.948498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f37ff-b9cf-4068-9c82-2b3d661987ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:10.950310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f37ff-b9cf-4068-9c82-2b3d661987ae service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:10.959500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 735/1446] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:13.477284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae9dfb-4f12-4ab0-aa8f-48f37551f649 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:13.477805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae9dfb-4f12-4ab0-aa8f-48f37551f649 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:13.477805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae9dfb-4f12-4ab0-aa8f-48f37551f649 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:13.479193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:13.485008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec563d6a-2820-4fe4-82c0-ff1bdca49b10 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:13.485413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec563d6a-2820-4fe4-82c0-ff1bdca49b10 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:13.485553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec563d6a-2820-4fe4-82c0-ff1bdca49b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:13.504759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-ec563d6a-2820-4fe4-82c0-ff1bdca49b10 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:13.505951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ec563d6a-2820-4fe4-82c0-ff1bdca49b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:13.513881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:13.552011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae9dfb-4f12-4ab0-aa8f-48f37551f649 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:13.563144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae9dfb-4f12-4ab0-aa8f-48f37551f649 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:13.566897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cd5ef-457b-4df0-87dd-2ffc04b57d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:13.567558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cd5ef-457b-4df0-87dd-2ffc04b57d96 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:13.567837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cd5ef-457b-4df0-87dd-2ffc04b57d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:13.568730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cd5ef-457b-4df0-87dd-2ffc04b57d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:13.580379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cd5ef-457b-4df0-87dd-2ffc04b57d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:13.582681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cd5ef-457b-4df0-87dd-2ffc04b57d96 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:13.592702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 713/1449] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:15.943068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa17b-1b10-4297-9763-18b8625ea242 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:15.943682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa17b-1b10-4297-9763-18b8625ea242 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:15.943682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa17b-1b10-4297-9763-18b8625ea242 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:15.945039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:15.950439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bd944-785a-45e6-b107-77521f9bf684 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:15.950854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bd944-785a-45e6-b107-77521f9bf684 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:15.950987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bd944-785a-45e6-b107-77521f9bf684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:15.968116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-f39bd944-785a-45e6-b107-77521f9bf684 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:15.969280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f39bd944-785a-45e6-b107-77521f9bf684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:15.976809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:16.014705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaa17b-1b10-4297-9763-18b8625ea242 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:16.025550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaa17b-1b10-4297-9763-18b8625ea242 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:16.029782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f82896-5984-4b70-8b1f-6eb74c050d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:16.030411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82896-5984-4b70-8b1f-6eb74c050d1f service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:16.030689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82896-5984-4b70-8b1f-6eb74c050d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:16.030957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82896-5984-4b70-8b1f-6eb74c050d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:16.039628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f82896-5984-4b70-8b1f-6eb74c050d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:16.041063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f82896-5984-4b70-8b1f-6eb74c050d1f service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:16.050767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 738/1452] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:18.293834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56cffb-589e-4604-beed-4989a4bbcd93 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:18.294337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56cffb-589e-4604-beed-4989a4bbcd93 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:18.294460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56cffb-589e-4604-beed-4989a4bbcd93 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:18.295766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:18.301067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec22d-4895-4409-893e-3f79c78dee5d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:18.301514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec22d-4895-4409-893e-3f79c78dee5d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:18.301608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec22d-4895-4409-893e-3f79c78dee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:18.320015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-68bec22d-4895-4409-893e-3f79c78dee5d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:18.321309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-68bec22d-4895-4409-893e-3f79c78dee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:18.329797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:18.366354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56cffb-589e-4604-beed-4989a4bbcd93 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:18.377270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56cffb-589e-4604-beed-4989a4bbcd93 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:18.380700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39095ab-c03c-41b9-b201-ce98d5d58482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:18.381320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39095ab-c03c-41b9-b201-ce98d5d58482 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:18.381590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39095ab-c03c-41b9-b201-ce98d5d58482 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:18.381855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39095ab-c03c-41b9-b201-ce98d5d58482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:18.391037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39095ab-c03c-41b9-b201-ce98d5d58482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:18.392473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39095ab-c03c-41b9-b201-ce98d5d58482 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:18.401478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 716/1455] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:20.666938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b674d7-1b2a-4a80-a221-19e4c0187965 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:20.667542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b674d7-1b2a-4a80-a221-19e4c0187965 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:20.667542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b674d7-1b2a-4a80-a221-19e4c0187965 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:20.668917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:20.674315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e67cc-6b0f-4bf0-badc-72883ab061f0 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:20.674751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e67cc-6b0f-4bf0-badc-72883ab061f0 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:20.674853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e67cc-6b0f-4bf0-badc-72883ab061f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:20.693094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ed2e67cc-6b0f-4bf0-badc-72883ab061f0 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:20.694269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ed2e67cc-6b0f-4bf0-badc-72883ab061f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:20.702433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:20.740362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b674d7-1b2a-4a80-a221-19e4c0187965 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:20.751737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b674d7-1b2a-4a80-a221-19e4c0187965 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:20.755201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413420d-7a8d-4c28-9ebc-fc961eded96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:20.755860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413420d-7a8d-4c28-9ebc-fc961eded96d service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:20.756131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413420d-7a8d-4c28-9ebc-fc961eded96d service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:20.756397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413420d-7a8d-4c28-9ebc-fc961eded96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:20.766011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413420d-7a8d-4c28-9ebc-fc961eded96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:20.767459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413420d-7a8d-4c28-9ebc-fc961eded96d service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:20.776550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 741/1458] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:23.034464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548441a4-9897-4306-a257-9a50009acd2c None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:23.035006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548441a4-9897-4306-a257-9a50009acd2c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:23.035006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548441a4-9897-4306-a257-9a50009acd2c None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:23.036417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:23.041826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed7ad4-b7f4-43a5-be74-d7862f320371 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:23.042821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed7ad4-b7f4-43a5-be74-d7862f320371 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:23.042957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed7ad4-b7f4-43a5-be74-d7862f320371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:23.060594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-ebed7ad4-b7f4-43a5-be74-d7862f320371 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:23.061785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ebed7ad4-b7f4-43a5-be74-d7862f320371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:23.069736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:23.106938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548441a4-9897-4306-a257-9a50009acd2c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:23.117362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548441a4-9897-4306-a257-9a50009acd2c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:23.120788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f86d7-8d99-4fad-b064-051340307fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:23.121410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f86d7-8d99-4fad-b064-051340307fac service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:23.121689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f86d7-8d99-4fad-b064-051340307fac service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:23.121959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f86d7-8d99-4fad-b064-051340307fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:23.130528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f86d7-8d99-4fad-b064-051340307fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:23.131970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f86d7-8d99-4fad-b064-051340307fac service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:23.141694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 719/1461] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:25.395663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24cfab-4d9f-4a54-848b-6bce8e6f8f1d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:25.396321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24cfab-4d9f-4a54-848b-6bce8e6f8f1d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:25.396321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24cfab-4d9f-4a54-848b-6bce8e6f8f1d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:25.397710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:25.403719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9e7c-ce33-4174-98c9-5ed7e28ae980 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:25.404149 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9e7c-ce33-4174-98c9-5ed7e28ae980 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:25.404358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9e7c-ce33-4174-98c9-5ed7e28ae980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:25.422006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-223d9e7c-ce33-4174-98c9-5ed7e28ae980 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:25.423193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-223d9e7c-ce33-4174-98c9-5ed7e28ae980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:25.430967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:25.468843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24cfab-4d9f-4a54-848b-6bce8e6f8f1d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:25.479346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24cfab-4d9f-4a54-848b-6bce8e6f8f1d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:25.482764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5d106-9ed2-4e95-83ef-a44103ee5ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:25.483429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d106-9ed2-4e95-83ef-a44103ee5ebc service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:25.483711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d106-9ed2-4e95-83ef-a44103ee5ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:25.483984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d106-9ed2-4e95-83ef-a44103ee5ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:25.492694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5d106-9ed2-4e95-83ef-a44103ee5ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:25.494130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5d106-9ed2-4e95-83ef-a44103ee5ebc service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:25.503520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 744/1464] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:27.732577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1fbbc-2efb-4cae-93d3-301eb8cff6b7 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:27.733118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1fbbc-2efb-4cae-93d3-301eb8cff6b7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:27.733118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1fbbc-2efb-4cae-93d3-301eb8cff6b7 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:27.734483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:27.739708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebdf94-2807-49f6-8575-becff12770aa None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:27.740106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebdf94-2807-49f6-8575-becff12770aa None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:27.740252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebdf94-2807-49f6-8575-becff12770aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:27.757898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-40ebdf94-2807-49f6-8575-becff12770aa None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:27.759069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-40ebdf94-2807-49f6-8575-becff12770aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:27.766640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:27.802031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1fbbc-2efb-4cae-93d3-301eb8cff6b7 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:27.813044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1fbbc-2efb-4cae-93d3-301eb8cff6b7 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:27.816471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce35f-90df-49a0-95de-6cafad508489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:27.817348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce35f-90df-49a0-95de-6cafad508489 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:27.817626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce35f-90df-49a0-95de-6cafad508489 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:27.817892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce35f-90df-49a0-95de-6cafad508489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:27.826511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce35f-90df-49a0-95de-6cafad508489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:27.827961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce35f-90df-49a0-95de-6cafad508489 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:27.837144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 722/1467] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:51:30.048925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8b571-c39e-4ec0-93cd-8b522b1593ce None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:30.049493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8b571-c39e-4ec0-93cd-8b522b1593ce None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:30.049493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8b571-c39e-4ec0-93cd-8b522b1593ce None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:30.050851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:51:30.056291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c7bae-88ae-4043-818d-81bc998e2c85 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:30.056712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c7bae-88ae-4043-818d-81bc998e2c85 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:30.056823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c7bae-88ae-4043-818d-81bc998e2c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:30.074722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d09c7bae-88ae-4043-818d-81bc998e2c85 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:51:30.075938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d09c7bae-88ae-4043-818d-81bc998e2c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:51:30.083469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:51:30.119926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8b571-c39e-4ec0-93cd-8b522b1593ce None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:51:30.130330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8b571-c39e-4ec0-93cd-8b522b1593ce None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:51:30.133789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72301719-02d1-482a-b069-1ed37015261f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:51:30.134411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72301719-02d1-482a-b069-1ed37015261f service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:51:30.134692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72301719-02d1-482a-b069-1ed37015261f service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:51:30.134963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72301719-02d1-482a-b069-1ed37015261f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:51:30.144142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72301719-02d1-482a-b069-1ed37015261f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:51:30.145569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72301719-02d1-482a-b069-1ed37015261f service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:51:30.155247 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 747/1470] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:52:03.523356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c83d5-f752-40be-86b6-6d3111d591d6 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:03.523962 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c83d5-f752-40be-86b6-6d3111d591d6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:03.523962 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c83d5-f752-40be-86b6-6d3111d591d6 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:03.525188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 724/1471] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:52:03.530474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533095-205d-491b-b083-208961c7e4da None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:03.530939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533095-205d-491b-b083-208961c7e4da None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:03.531042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533095-205d-491b-b083-208961c7e4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:03.549252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-26533095-205d-491b-b083-208961c7e4da None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:52:03.550596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-26533095-205d-491b-b083-208961c7e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:52:03.560565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 748/1472] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:52:03.607746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa283fb-ffc7-43f0-91ba-86674c0d5aaf None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:03.608034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa283fb-ffc7-43f0-91ba-86674c0d5aaf None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:03.608307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa283fb-ffc7-43f0-91ba-86674c0d5aaf None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:03.609689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 725/1473] 10.222.0.93 () {54 vars in 962 bytes} [Wed May 11 18:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:52:03.614390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf692-67dc-49e6-9798-2ff6c301b24b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:03.614707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf692-67dc-49e6-9798-2ff6c301b24b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:03.614982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abf692-67dc-49e6-9798-2ff6c301b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:03.632961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-55abf692-67dc-49e6-9798-2ff6c301b24b None None] MFA Rules not processed for user `9a1d39dd41c348cb9cfdde6fa15da315`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:52:03.634140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-55abf692-67dc-49e6-9798-2ff6c301b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:52:03.640461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 749/1474] 10.222.0.93 () {58 vars in 1059 bytes} [Wed May 11 18:52:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:52:03.647767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa283fb-ffc7-43f0-91ba-86674c0d5aaf None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:52:03.659987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa283fb-ffc7-43f0-91ba-86674c0d5aaf None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:52:03.663519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba70fd-2791-405c-a679-3849a469bb70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:52:03.664157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba70fd-2791-405c-a679-3849a469bb70 service glance] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:03.664433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba70fd-2791-405c-a679-3849a469bb70 service glance] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:03.664697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba70fd-2791-405c-a679-3849a469bb70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:03.674573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba70fd-2791-405c-a679-3849a469bb70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:52:03.676217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba70fd-2791-405c-a679-3849a469bb70 service glance] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:52:03.687451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 726/1475] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:52:06.062932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2f6d-a725-4831-88fa-433990587ad6 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:06.063552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2f6d-a725-4831-88fa-433990587ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:06.063552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2f6d-a725-4831-88fa-433990587ad6 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:06.064931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 750/1476] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:52:06.070488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa43f4-e026-4652-8968-ec47a3cb9bb7 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:06.070965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa43f4-e026-4652-8968-ec47a3cb9bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:06.071082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa43f4-e026-4652-8968-ec47a3cb9bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:06.089377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9aaa43f4-e026-4652-8968-ec47a3cb9bb7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:52:06.090561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9aaa43f4-e026-4652-8968-ec47a3cb9bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:52:06.098219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 727/1477] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:52:06.121319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2f6d-a725-4831-88fa-433990587ad6 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:52:06.133679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2f6d-a725-4831-88fa-433990587ad6 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:52:06.138564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e90505-dfe2-47b2-87b6-7d669badf9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:52:06.139195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90505-dfe2-47b2-87b6-7d669badf9ed admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:06.139528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90505-dfe2-47b2-87b6-7d669badf9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:06.139801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e90505-dfe2-47b2-87b6-7d669badf9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:06.140526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e90505-dfe2-47b2-87b6-7d669badf9ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:52:06.142295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING py.warnings [None req-51e90505-dfe2-47b2-87b6-7d669badf9ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:52:06.142295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: warnings.warn(msg) May 11 18:52:06.142295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: May 11 18:52:06.143459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e90505-dfe2-47b2-87b6-7d669badf9ed admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:52:06.163996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 751/1478] 10.222.0.93 () {56 vars in 1108 bytes} [Wed May 11 18:52:06 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:52:08.380474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e20772-6021-46e5-9f94-5e8f9627a3a0 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:08.380991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e20772-6021-46e5-9f94-5e8f9627a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:08.380991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e20772-6021-46e5-9f94-5e8f9627a3a0 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:08.382334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 728/1479] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:52:08.387784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543f8a-e9c3-4364-bfd7-1c0bd7f72d38 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:08.388362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543f8a-e9c3-4364-bfd7-1c0bd7f72d38 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:08.388362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543f8a-e9c3-4364-bfd7-1c0bd7f72d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:08.408185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b1543f8a-e9c3-4364-bfd7-1c0bd7f72d38 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:52:08.409393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b1543f8a-e9c3-4364-bfd7-1c0bd7f72d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:52:08.417669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 752/1480] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:52:08.460247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e20772-6021-46e5-9f94-5e8f9627a3a0 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:52:08.474792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e20772-6021-46e5-9f94-5e8f9627a3a0 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:52:08.480590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e579d9-df54-4299-b876-f095aa3d065d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:52:08.481234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e579d9-df54-4299-b876-f095aa3d065d service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:08.481493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e579d9-df54-4299-b876-f095aa3d065d service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:08.481760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e579d9-df54-4299-b876-f095aa3d065d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:08.489641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e579d9-df54-4299-b876-f095aa3d065d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:52:08.491202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e579d9-df54-4299-b876-f095aa3d065d service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:52:08.500908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 729/1481] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:52:10.872384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501456f-bd80-4eb9-93a2-425094d8e340 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:10.872947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501456f-bd80-4eb9-93a2-425094d8e340 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:10.872947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501456f-bd80-4eb9-93a2-425094d8e340 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:10.874388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 753/1482] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:52:10.879731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b0ca9-8479-425c-bb6b-877d540293e4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:10.880148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b0ca9-8479-425c-bb6b-877d540293e4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:10.880280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b0ca9-8479-425c-bb6b-877d540293e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:10.897460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-157b0ca9-8479-425c-bb6b-877d540293e4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:52:10.898632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-157b0ca9-8479-425c-bb6b-877d540293e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:52:10.906834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 730/1483] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:52:10.941869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501456f-bd80-4eb9-93a2-425094d8e340 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:52:10.952581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501456f-bd80-4eb9-93a2-425094d8e340 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:52:10.956071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fc224-9ff2-4f8f-8887-7c1671b1b655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:52:10.956694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fc224-9ff2-4f8f-8887-7c1671b1b655 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:10.956972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fc224-9ff2-4f8f-8887-7c1671b1b655 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:10.957267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fc224-9ff2-4f8f-8887-7c1671b1b655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:10.966432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fc224-9ff2-4f8f-8887-7c1671b1b655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:52:10.967890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fc224-9ff2-4f8f-8887-7c1671b1b655 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:52:10.977010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 754/1484] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:52:13.256031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9ad92-4ea8-481d-ac7c-51a4619a9bb0 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:13.256551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9ad92-4ea8-481d-ac7c-51a4619a9bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:13.256551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9ad92-4ea8-481d-ac7c-51a4619a9bb0 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:13.257923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 731/1485] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:52:13.263077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d5fc-7a2d-4e15-9d6b-b826d0aea165 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:13.263552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d5fc-7a2d-4e15-9d6b-b826d0aea165 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:13.263658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d5fc-7a2d-4e15-9d6b-b826d0aea165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:13.282355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c3d3d5fc-7a2d-4e15-9d6b-b826d0aea165 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:52:13.283587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c3d3d5fc-7a2d-4e15-9d6b-b826d0aea165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:52:13.291230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 755/1486] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:52:13.328693 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9ad92-4ea8-481d-ac7c-51a4619a9bb0 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:52:13.339502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9ad92-4ea8-481d-ac7c-51a4619a9bb0 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:52:13.342894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84d18-06f9-423f-b85f-4ed54d3ae1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:52:13.343549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d18-06f9-423f-b85f-4ed54d3ae1fb service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:13.343827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d18-06f9-423f-b85f-4ed54d3ae1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:13.344094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d18-06f9-423f-b85f-4ed54d3ae1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:13.352596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84d18-06f9-423f-b85f-4ed54d3ae1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:52:13.354067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84d18-06f9-423f-b85f-4ed54d3ae1fb service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:52:13.363550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 732/1487] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:52:15.743058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f3fff-6d73-4588-b4ac-473da57ee042 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:15.743717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f3fff-6d73-4588-b4ac-473da57ee042 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:15.743717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f3fff-6d73-4588-b4ac-473da57ee042 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:15.745644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 756/1488] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:52:15.750733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f335-abb0-4b71-b95e-d6cf4666314a None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:15.751142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f335-abb0-4b71-b95e-d6cf4666314a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:15.751280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f335-abb0-4b71-b95e-d6cf4666314a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:15.768504 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-e989f335-abb0-4b71-b95e-d6cf4666314a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:52:15.769684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e989f335-abb0-4b71-b95e-d6cf4666314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:52:15.777309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 733/1489] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:52:15.817842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f3fff-6d73-4588-b4ac-473da57ee042 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:52:15.828515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f3fff-6d73-4588-b4ac-473da57ee042 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:52:15.832030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a06b4-0886-4d31-9194-4159f9da8104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:52:15.832659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a06b4-0886-4d31-9194-4159f9da8104 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:15.832934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a06b4-0886-4d31-9194-4159f9da8104 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:15.833201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a06b4-0886-4d31-9194-4159f9da8104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:15.842186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a06b4-0886-4d31-9194-4159f9da8104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:52:15.843673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a06b4-0886-4d31-9194-4159f9da8104 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:52:15.853111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 757/1490] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:52:18.239955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343f641-d126-497c-9a4a-ae8210cf5f56 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:18.240428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343f641-d126-497c-9a4a-ae8210cf5f56 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:18.240544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343f641-d126-497c-9a4a-ae8210cf5f56 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:18.241876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 734/1491] 10.222.0.93 () {54 vars in 926 bytes} [Wed May 11 18:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:52:18.247660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355c13-8565-42e8-9eae-7374309d4c9b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:18.248150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355c13-8565-42e8-9eae-7374309d4c9b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:18.248249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355c13-8565-42e8-9eae-7374309d4c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:18.265969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a3355c13-8565-42e8-9eae-7374309d4c9b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:52:18.267167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a3355c13-8565-42e8-9eae-7374309d4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:52:18.274839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 758/1492] 10.222.0.93 () {58 vars in 1023 bytes} [Wed May 11 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:52:18.312599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343f641-d126-497c-9a4a-ae8210cf5f56 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:52:18.323911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343f641-d126-497c-9a4a-ae8210cf5f56 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:52:18.327412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e4896-5aca-46a3-a569-7626f04d25fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:52:18.328041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e4896-5aca-46a3-a569-7626f04d25fa service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:52:18.328320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e4896-5aca-46a3-a569-7626f04d25fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:52:18.328594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e4896-5aca-46a3-a569-7626f04d25fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:52:18.337221 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e4896-5aca-46a3-a569-7626f04d25fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:52:18.338660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e4896-5aca-46a3-a569-7626f04d25fa service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:52:18.347887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 735/1493] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:53:45.031172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9268f-5c3a-4db8-9372-ac37220a2243 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.031825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9268f-5c3a-4db8-9372-ac37220a2243 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.031825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9268f-5c3a-4db8-9372-ac37220a2243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.049685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-4ef9268f-5c3a-4db8-9372-ac37220a2243 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:53:45.050872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4ef9268f-5c3a-4db8-9372-ac37220a2243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:53:45.058353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 759/1494] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:53:45.067317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2c44-0cb9-4852-adcf-73c76d99b396 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.067801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2c44-0cb9-4852-adcf-73c76d99b396 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.067903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2c44-0cb9-4852-adcf-73c76d99b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.085477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ccfa2c44-0cb9-4852-adcf-73c76d99b396 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:53:45.086659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ccfa2c44-0cb9-4852-adcf-73c76d99b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:53:45.094796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 736/1495] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:53:45.099101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9268f-5c3a-4db8-9372-ac37220a2243 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.109101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9268f-5c3a-4db8-9372-ac37220a2243 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:45.113511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:45.114149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.114438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.114704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.115448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:53:45.115752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:45.116801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING py.warnings [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:53:45.116801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: warnings.warn(msg) May 11 18:53:45.116801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: May 11 18:53:45.117707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:45.128775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 760/1496] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:53:45.136782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2c44-0cb9-4852-adcf-73c76d99b396 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.145853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2c44-0cb9-4852-adcf-73c76d99b396 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:45.150282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:45.151503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.151799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.152055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.152739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:45.154473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING py.warnings [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:53:45.154473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: warnings.warn(msg) May 11 18:53:45.154473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: May 11 18:53:45.155682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:45.191069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 737/1497] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:53:45 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:53:45.195597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.205313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1362e-f708-473d-a6ad-7c0489e22774 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:45.258432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:45.259091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.259397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.259671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.260873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:45.261886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING py.warnings [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:53:45.261886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: warnings.warn(msg) May 11 18:53:45.261886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: May 11 18:53:45.263071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:45.282299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 761/1498] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:53:45 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:53:45.286384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.296645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c76aae-829b-4fa1-8c81-e10fdf26b401 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:45.301021 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:45.301675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.301949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.302216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.302933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:45.303999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING py.warnings [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:53:45.303999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: warnings.warn(msg) May 11 18:53:45.303999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: May 11 18:53:45.304857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:45.318742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 738/1499] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:53:45.324130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.333804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610d094-5760-4848-b174-764608f5f77f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:45.338902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43219636-6276-46ea-86d2-7721788cfa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:45.339575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219636-6276-46ea-86d2-7721788cfa9a admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.339853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219636-6276-46ea-86d2-7721788cfa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.340126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219636-6276-46ea-86d2-7721788cfa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.340837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43219636-6276-46ea-86d2-7721788cfa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:45.341872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING py.warnings [None req-43219636-6276-46ea-86d2-7721788cfa9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:53:45.341872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: warnings.warn(msg) May 11 18:53:45.341872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: May 11 18:53:45.342720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43219636-6276-46ea-86d2-7721788cfa9a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:45.355636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 762/1500] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:53:45.361682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.372412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de5c9-c00b-4343-98e3-d7b8b21f27b4 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:45.376883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74e03d-a36c-4a29-b3c2-5f0ca039cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:45.377770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74e03d-a36c-4a29-b3c2-5f0ca039cd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.378041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74e03d-a36c-4a29-b3c2-5f0ca039cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.378307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74e03d-a36c-4a29-b3c2-5f0ca039cd4d admin admin] PATH_INFO: `/v3/projects/2f1df7687eed4b2184a234ec5887c527/users/0674361fb3064c589f02a84f361be5f8/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.393535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74e03d-a36c-4a29-b3c2-5f0ca039cd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1df7687eed4b2184a234ec5887c527, user_id=0674361fb3064c589f02a84f361be5f8, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:45.394558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING py.warnings [None req-da74e03d-a36c-4a29-b3c2-5f0ca039cd4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:53:45.394558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: warnings.warn(msg) May 11 18:53:45.394558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: May 11 18:53:45.396495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74e03d-a36c-4a29-b3c2-5f0ca039cd4d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:45.409929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 739/1501] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:53:45 2022] PUT /identity/v3/projects/2f1df7687eed4b2184a234ec5887c527/users/0674361fb3064c589f02a84f361be5f8/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:53:45.421430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ddac6-cd9f-4998-8c42-b655848d0f09 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.421717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ddac6-cd9f-4998-8c42-b655848d0f09 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.421982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ddac6-cd9f-4998-8c42-b655848d0f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.448323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-6f1ddac6-cd9f-4998-8c42-b655848d0f09 None None] MFA Rules not processed for user `0674361fb3064c589f02a84f361be5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:53:45.449514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6f1ddac6-cd9f-4998-8c42-b655848d0f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:53:45.511614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 763/1502] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:53:45.524935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf472-c63f-4f57-96b7-ee2822b84fee None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.525241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf472-c63f-4f57-96b7-ee2822b84fee None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.525511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf472-c63f-4f57-96b7-ee2822b84fee None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.527477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 740/1503] 10.222.0.93 () {54 vars in 963 bytes} [Wed May 11 18:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:53:45.532399 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45111ca-bd11-450d-85bd-625d493b135a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.532653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45111ca-bd11-450d-85bd-625d493b135a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.532923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45111ca-bd11-450d-85bd-625d493b135a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.550433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c45111ca-bd11-450d-85bd-625d493b135a None None] MFA Rules not processed for user `ae471a0d19b04d1daf634d6d2c73645a`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:53:45.551701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c45111ca-bd11-450d-85bd-625d493b135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:53:45.600786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 764/1504] 10.222.0.93 () {58 vars in 1060 bytes} [Wed May 11 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:53:45.608247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cf472-c63f-4f57-96b7-ee2822b84fee None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.620310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cf472-c63f-4f57-96b7-ee2822b84fee None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:45.623997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cafd-426d-4c80-b850-4418646cdfc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:45.624629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cafd-426d-4c80-b850-4418646cdfc3 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.624905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cafd-426d-4c80-b850-4418646cdfc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.625175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cafd-426d-4c80-b850-4418646cdfc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.633294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658cafd-426d-4c80-b850-4418646cdfc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:45.634701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658cafd-426d-4c80-b850-4418646cdfc3 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:45.643755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 741/1505] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:53:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:53:45.685142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c7a4-02f2-4865-9fa0-b9dafa27555f None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.685432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c7a4-02f2-4865-9fa0-b9dafa27555f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.685707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c7a4-02f2-4865-9fa0-b9dafa27555f None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.686987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 765/1506] 10.222.0.93 () {52 vars in 829 bytes} [Wed May 11 18:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:53:45.690434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cafd-426d-4c80-b850-4418646cdfc3 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.749793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cafd-426d-4c80-b850-4418646cdfc3 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:45.754358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:45.755251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.755555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.755822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] PATH_INFO: `/v3/users/0674361fb3064c589f02a84f361be5f8` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.757025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0674361fb3064c589f02a84f361be5f8)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:45.758035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING py.warnings [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:53:45.758035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: warnings.warn(msg) May 11 18:53:45.758035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: May 11 18:53:45.759273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:45.821529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0674361fb3064c589f02a84f361be5f8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:45.834163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0674361fb3064c589f02a84f361be5f8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:45.834916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0674361fb3064c589f02a84f361be5f8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:45.844231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0674361fb3064c589f02a84f361be5f8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:45.845090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0674361fb3064c589f02a84f361be5f8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:45.868871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 742/1507] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:53:45 2022] DELETE /identity/v3/users/0674361fb3064c589f02a84f361be5f8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:53:45.873927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877de75-f2a2-4d15-a943-835875bb2a8f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:45.874288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877de75-f2a2-4d15-a943-835875bb2a8f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:45.874632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877de75-f2a2-4d15-a943-835875bb2a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:45.892528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a877de75-f2a2-4d15-a943-835875bb2a8f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:53:45.893731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a877de75-f2a2-4d15-a943-835875bb2a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:53:45.949910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 766/1508] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:53:45.959423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:45.960834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:53:46.014834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7c0fa-6fa0-42d5-8b66-c9db2b678b7d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:46.018589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf7615-0944-40c1-badf-028e41559a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:46.019236 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf7615-0944-40c1-badf-028e41559a7f service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:46.019553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf7615-0944-40c1-badf-028e41559a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:46.019831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf7615-0944-40c1-badf-028e41559a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:46.028781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf7615-0944-40c1-badf-028e41559a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:46.030208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf7615-0944-40c1-badf-028e41559a7f service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:46.039356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 743/1509] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:53:46.356475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877de75-f2a2-4d15-a943-835875bb2a8f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:53:46.357961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a877de75-f2a2-4d15-a943-835875bb2a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:53:46.369980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877de75-f2a2-4d15-a943-835875bb2a8f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:53:46.375439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:53:46.376360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:53:46.376584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:53:46.376857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] PATH_INFO: `/v3/projects/2f1df7687eed4b2184a234ec5887c527` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:53:46.378123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1df7687eed4b2184a234ec5887c527)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:53:46.379142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING py.warnings [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:53:46.379142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: warnings.warn(msg) May 11 18:53:46.379142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: May 11 18:53:46.380588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:53:46.445560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1df7687eed4b2184a234ec5887c527', 'request_id': 'req-b2f5de16-8817-4674-b50f-e15e9dd8c768'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:46.456574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1df7687eed4b2184a234ec5887c527', 'request_id': 'req-b2f5de16-8817-4674-b50f-e15e9dd8c768'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:46.463172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1df7687eed4b2184a234ec5887c527', 'request_id': 'req-b2f5de16-8817-4674-b50f-e15e9dd8c768'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:46.481480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] The token cache is being invalidate because project 2f1df7687eed4b2184a234ec5887c527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:53:46.481766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:46.482503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2f5de16-8817-4674-b50f-e15e9dd8c768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:53:46.484159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 767/1510] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:53:46 2022] DELETE /identity/v3/projects/2f1df7687eed4b2184a234ec5887c527 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:55:31.079759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df60f-d69b-41f2-a305-170e78b7001a None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:31.080377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df60f-d69b-41f2-a305-170e78b7001a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:31.080377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df60f-d69b-41f2-a305-170e78b7001a None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:31.081667 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:31.086426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0a6e-7f67-458f-bb52-6d867c29be3b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:31.086860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0a6e-7f67-458f-bb52-6d867c29be3b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:31.086995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0a6e-7f67-458f-bb52-6d867c29be3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:31.104670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-965a0a6e-7f67-458f-bb52-6d867c29be3b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:31.105877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-965a0a6e-7f67-458f-bb52-6d867c29be3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:31.162065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:31.328626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7df60f-d69b-41f2-a305-170e78b7001a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:31.330336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0c7df60f-d69b-41f2-a305-170e78b7001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:31.404176 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7df60f-d69b-41f2-a305-170e78b7001a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:31.409534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef49ea-32d8-4753-a82a-80010dbd541f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:31.410296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef49ea-32d8-4753-a82a-80010dbd541f service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:31.410582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef49ea-32d8-4753-a82a-80010dbd541f service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:31.410899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef49ea-32d8-4753-a82a-80010dbd541f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:31.419683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef49ea-32d8-4753-a82a-80010dbd541f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:31.421269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef49ea-32d8-4753-a82a-80010dbd541f service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:31.431830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 745/1513] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:55:32.186833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eeed7-296b-4b25-bf34-d70c1100c30f None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:32.187432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eeed7-296b-4b25-bf34-d70c1100c30f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:32.187432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eeed7-296b-4b25-bf34-d70c1100c30f None None] PATH_INFO: `/v3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:32.188720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 769/1514] 10.222.0.96 () {54 vars in 925 bytes} [Wed May 11 18:55:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:55:32.195224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2faec-8a3c-4e92-bbc4-87f38600d1b4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:32.195689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2faec-8a3c-4e92-bbc4-87f38600d1b4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:32.195861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2faec-8a3c-4e92-bbc4-87f38600d1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:32.215597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-01c2faec-8a3c-4e92-bbc4-87f38600d1b4 None None] MFA Rules not processed for user `911d21a666844fc399286e24c2892184`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:32.216818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-01c2faec-8a3c-4e92-bbc4-87f38600d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:32.277283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 746/1515] 10.222.0.96 () {58 vars in 1015 bytes} [Wed May 11 18:55:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:32.322336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317449-b9a8-4592-b1ab-2dd310b4954f None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:32.322625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317449-b9a8-4592-b1ab-2dd310b4954f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:32.322903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317449-b9a8-4592-b1ab-2dd310b4954f None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:32.324329 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 770/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:32.329007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3daec-c783-4694-924b-ca17c0077ad2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:32.329299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3daec-c783-4694-924b-ca17c0077ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:32.329576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3daec-c783-4694-924b-ca17c0077ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:32.347955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-3cc3daec-c783-4694-924b-ca17c0077ad2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:32.349138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3cc3daec-c783-4694-924b-ca17c0077ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:32.356908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 747/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:32.505425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317449-b9a8-4592-b1ab-2dd310b4954f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:32.519778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317449-b9a8-4592-b1ab-2dd310b4954f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:32.525026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f53748-cd3f-47c5-8575-7f12c9c596a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:32.525655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f53748-cd3f-47c5-8575-7f12c9c596a9 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:32.525930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f53748-cd3f-47c5-8575-7f12c9c596a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:32.526199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f53748-cd3f-47c5-8575-7f12c9c596a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:32.534039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f53748-cd3f-47c5-8575-7f12c9c596a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:32.535663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f53748-cd3f-47c5-8575-7f12c9c596a9 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:32.544777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 771/1518] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:55:41.793229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db4ec5-8135-4caa-befa-d7997c1e1865 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:41.793775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db4ec5-8135-4caa-befa-d7997c1e1865 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:41.793775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db4ec5-8135-4caa-befa-d7997c1e1865 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:41.795135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 748/1519] 10.222.0.93 () {54 vars in 960 bytes} [Wed May 11 18:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:41.800219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e6be-740d-4729-b074-1cf188d2a038 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:41.800643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e6be-740d-4729-b074-1cf188d2a038 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:41.800802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e6be-740d-4729-b074-1cf188d2a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:41.818674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b764e6be-740d-4729-b074-1cf188d2a038 None None] MFA Rules not processed for user `911d21a666844fc399286e24c2892184`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:41.820149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b764e6be-740d-4729-b074-1cf188d2a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:41.828539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 772/1520] 10.222.0.93 () {58 vars in 1057 bytes} [Wed May 11 18:55:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:41.835723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db4ec5-8135-4caa-befa-d7997c1e1865 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:41.849038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db4ec5-8135-4caa-befa-d7997c1e1865 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:41.854410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613788c-4603-47e3-993b-e6c03534aadb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '911d21a666844fc399286e24c2892184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:41.855035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613788c-4603-47e3-993b-e6c03534aadb service placement] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:41.855340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613788c-4603-47e3-993b-e6c03534aadb service placement] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:41.855620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613788c-4603-47e3-993b-e6c03534aadb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:41.863628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613788c-4603-47e3-993b-e6c03534aadb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:41.865198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613788c-4603-47e3-993b-e6c03534aadb service placement] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:41.874536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 749/1521] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:55:43.867223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd064e-bf2a-4e3b-976f-c83332049968 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:43.868294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd064e-bf2a-4e3b-976f-c83332049968 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:43.868294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd064e-bf2a-4e3b-976f-c83332049968 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:43.869580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 773/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:43.874425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84e61-637a-4d2c-b291-11abe3aa637c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:43.874846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84e61-637a-4d2c-b291-11abe3aa637c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:43.874980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84e61-637a-4d2c-b291-11abe3aa637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:43.894867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-1aa84e61-637a-4d2c-b291-11abe3aa637c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:43.896107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1aa84e61-637a-4d2c-b291-11abe3aa637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:43.903816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 750/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:44.057473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd064e-bf2a-4e3b-976f-c83332049968 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:44.071742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd064e-bf2a-4e3b-976f-c83332049968 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:44.077047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f499c3-3e61-4441-bb6e-1d48e246a24e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:44.077683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499c3-3e61-4441-bb6e-1d48e246a24e service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:44.077959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499c3-3e61-4441-bb6e-1d48e246a24e service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:44.078231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499c3-3e61-4441-bb6e-1d48e246a24e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:44.086113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f499c3-3e61-4441-bb6e-1d48e246a24e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:44.088255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f499c3-3e61-4441-bb6e-1d48e246a24e service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:44.097343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 774/1524] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:55:44.980011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02daa30-9648-4873-bec4-2502e004b508 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:44.980600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02daa30-9648-4873-bec4-2502e004b508 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:44.980600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02daa30-9648-4873-bec4-2502e004b508 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:44.981967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 751/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 18:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:44.986812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb2b7-1eca-485d-98be-f7ed5ed52446 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:44.987222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb2b7-1eca-485d-98be-f7ed5ed52446 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:44.987359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb2b7-1eca-485d-98be-f7ed5ed52446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:45.005781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c79fb2b7-1eca-485d-98be-f7ed5ed52446 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:45.006994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c79fb2b7-1eca-485d-98be-f7ed5ed52446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:45.014764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 775/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 18:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:45.165879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02daa30-9648-4873-bec4-2502e004b508 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:45.180043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02daa30-9648-4873-bec4-2502e004b508 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:45.185963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232657c4-05e0-4602-bea7-9c04cce36e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:45.186592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232657c4-05e0-4602-bea7-9c04cce36e63 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:45.186868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232657c4-05e0-4602-bea7-9c04cce36e63 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:45.187141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232657c4-05e0-4602-bea7-9c04cce36e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:45.195305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232657c4-05e0-4602-bea7-9c04cce36e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:45.196914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232657c4-05e0-4602-bea7-9c04cce36e63 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:45.206492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 752/1527] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:55:49.294539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc1e2-23b8-430f-8f3f-3b4813dfbc5c None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:49.295092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc1e2-23b8-430f-8f3f-3b4813dfbc5c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:49.295092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc1e2-23b8-430f-8f3f-3b4813dfbc5c None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:49.296544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 776/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:49.301892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aaa9a-a264-4c62-bc55-a21833eaa2c7 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:49.302337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aaa9a-a264-4c62-bc55-a21833eaa2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:49.302440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aaa9a-a264-4c62-bc55-a21833eaa2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:49.324384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-f01aaa9a-a264-4c62-bc55-a21833eaa2c7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:49.325593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f01aaa9a-a264-4c62-bc55-a21833eaa2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:49.333384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 753/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:49.370944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcc1e2-23b8-430f-8f3f-3b4813dfbc5c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:49.372669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c4bcc1e2-23b8-430f-8f3f-3b4813dfbc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:49.427416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcc1e2-23b8-430f-8f3f-3b4813dfbc5c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:49.431479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724498d-b870-4a3c-a5cb-8ecd863f1bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:49.432117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724498d-b870-4a3c-a5cb-8ecd863f1bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:49.432396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724498d-b870-4a3c-a5cb-8ecd863f1bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:49.432672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724498d-b870-4a3c-a5cb-8ecd863f1bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:49.441531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724498d-b870-4a3c-a5cb-8ecd863f1bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:49.442967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724498d-b870-4a3c-a5cb-8ecd863f1bc2 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:49.452458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 777/1530] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:55:51.661819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b01ed-2f29-42e5-b510-6e5be531cf32 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:51.662346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b01ed-2f29-42e5-b510-6e5be531cf32 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:51.662443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b01ed-2f29-42e5-b510-6e5be531cf32 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:51.663899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 754/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:51.669618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb717-a1aa-40e8-83f0-c974f0e41662 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:51.670086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb717-a1aa-40e8-83f0-c974f0e41662 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:51.670184 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb717-a1aa-40e8-83f0-c974f0e41662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:51.687820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c92fb717-a1aa-40e8-83f0-c974f0e41662 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:51.689009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c92fb717-a1aa-40e8-83f0-c974f0e41662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:51.697447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 778/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:51.732410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b01ed-2f29-42e5-b510-6e5be531cf32 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:51.743088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b01ed-2f29-42e5-b510-6e5be531cf32 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:51.746533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe79a44-8cf6-4287-b5ff-0d42f5130963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:51.747221 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe79a44-8cf6-4287-b5ff-0d42f5130963 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:51.747555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe79a44-8cf6-4287-b5ff-0d42f5130963 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:51.747827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe79a44-8cf6-4287-b5ff-0d42f5130963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:51.756623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe79a44-8cf6-4287-b5ff-0d42f5130963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:51.758523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe79a44-8cf6-4287-b5ff-0d42f5130963 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:51.767733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 755/1533] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:55:55.448355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b159ae-af16-40ef-bbf4-bcea76977c3d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:55.448843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b159ae-af16-40ef-bbf4-bcea76977c3d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:55.449008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b159ae-af16-40ef-bbf4-bcea76977c3d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:55.450412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 779/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:55.456053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad970b23-ff9c-4d25-b536-87ef217c7fd9 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:55.456503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad970b23-ff9c-4d25-b536-87ef217c7fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:55.456596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad970b23-ff9c-4d25-b536-87ef217c7fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:55.474700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ad970b23-ff9c-4d25-b536-87ef217c7fd9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:55.475871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ad970b23-ff9c-4d25-b536-87ef217c7fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:55.485003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 756/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:55:55.768571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b159ae-af16-40ef-bbf4-bcea76977c3d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:55.770368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d9b159ae-af16-40ef-bbf4-bcea76977c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:55.826861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b159ae-af16-40ef-bbf4-bcea76977c3d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:55.830425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e681f-0c33-4d58-ab87-8dbeaa9a36de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:55.831065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e681f-0c33-4d58-ab87-8dbeaa9a36de service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:55.831373 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e681f-0c33-4d58-ab87-8dbeaa9a36de service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:55.831649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e681f-0c33-4d58-ab87-8dbeaa9a36de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:55.840992 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e681f-0c33-4d58-ab87-8dbeaa9a36de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:55.842450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e681f-0c33-4d58-ab87-8dbeaa9a36de service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:55.851720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 780/1536] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:55:58.116309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29f51-6a0e-4541-b664-bb5f240f2659 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:58.116879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29f51-6a0e-4541-b664-bb5f240f2659 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:58.116879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29f51-6a0e-4541-b664-bb5f240f2659 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:58.118788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 757/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 18:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:55:58.124011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023dcc5-f905-4aa5-b4d9-8b1feec28f27 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:58.124464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023dcc5-f905-4aa5-b4d9-8b1feec28f27 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:58.124569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023dcc5-f905-4aa5-b4d9-8b1feec28f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:58.142006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7023dcc5-f905-4aa5-b4d9-8b1feec28f27 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:55:58.143196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7023dcc5-f905-4aa5-b4d9-8b1feec28f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:58.150804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 781/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 18:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:55:58.422678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29f51-6a0e-4541-b664-bb5f240f2659 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:55:58.424378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ccc29f51-6a0e-4541-b664-bb5f240f2659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:55:58.437488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29f51-6a0e-4541-b664-bb5f240f2659 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:55:58.440972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1cafb-4a27-4838-a1b0-55107a0a5528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:55:58.441602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1cafb-4a27-4838-a1b0-55107a0a5528 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:55:58.441885 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1cafb-4a27-4838-a1b0-55107a0a5528 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:55:58.442161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1cafb-4a27-4838-a1b0-55107a0a5528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:55:58.451244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1cafb-4a27-4838-a1b0-55107a0a5528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:55:58.452669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1cafb-4a27-4838-a1b0-55107a0a5528 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:55:58.462331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 758/1539] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:29.967753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7410ee-aa60-4ce3-90fc-cf161e8e35b6 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:29.968707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7410ee-aa60-4ce3-90fc-cf161e8e35b6 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:29.968707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7410ee-aa60-4ce3-90fc-cf161e8e35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.010697 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-cc7410ee-aa60-4ce3-90fc-cf161e8e35b6 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.011924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-cc7410ee-aa60-4ce3-90fc-cf161e8e35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.026633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 782/1540] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:57:30.037141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387197-59a7-4f2b-a282-bbc0de36af6b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.038720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387197-59a7-4f2b-a282-bbc0de36af6b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.039225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387197-59a7-4f2b-a282-bbc0de36af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.063629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-32387197-59a7-4f2b-a282-bbc0de36af6b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.065178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-32387197-59a7-4f2b-a282-bbc0de36af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.078883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 759/1541] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.083868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7410ee-aa60-4ce3-90fc-cf161e8e35b6 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.096541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7410ee-aa60-4ce3-90fc-cf161e8e35b6 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.104299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.105230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.105729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.106217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.107160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:30.107719 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.109548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.129284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 783/1542] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:30.135944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32387197-59a7-4f2b-a282-bbc0de36af6b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.145710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32387197-59a7-4f2b-a282-bbc0de36af6b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.152549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0384f93-6847-4f3c-9e82-3ea66a88d225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.153485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0384f93-6847-4f3c-9e82-3ea66a88d225 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.153974 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0384f93-6847-4f3c-9e82-3ea66a88d225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.154657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0384f93-6847-4f3c-9e82-3ea66a88d225 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.155614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0384f93-6847-4f3c-9e82-3ea66a88d225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.157857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0384f93-6847-4f3c-9e82-3ea66a88d225 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.200443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 760/1543] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:30.210523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.218098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593885-a076-4f35-8608-d277e3b894c4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.219708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593885-a076-4f35-8608-d277e3b894c4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.221273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593885-a076-4f35-8608-d277e3b894c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.226211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d34571-ddac-47b0-b560-e32d69d11bbe admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.250466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-88593885-a076-4f35-8608-d277e3b894c4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.256672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-88593885-a076-4f35-8608-d277e3b894c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.342192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797547-0efe-432d-a79b-2adca3bbf845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.342192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797547-0efe-432d-a79b-2adca3bbf845 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.342192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797547-0efe-432d-a79b-2adca3bbf845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.342192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797547-0efe-432d-a79b-2adca3bbf845 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.342659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797547-0efe-432d-a79b-2adca3bbf845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.344357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797547-0efe-432d-a79b-2adca3bbf845 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.364797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 761/1544] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.376483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852d453-b1b3-4cde-8f5f-beae5eb48d7a None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.377144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852d453-b1b3-4cde-8f5f-beae5eb48d7a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.377629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852d453-b1b3-4cde-8f5f-beae5eb48d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.377763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 784/1545] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:30.381997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797547-0efe-432d-a79b-2adca3bbf845 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.392889 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797547-0efe-432d-a79b-2adca3bbf845 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.407622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-6852d453-b1b3-4cde-8f5f-beae5eb48d7a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.409157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6852d453-b1b3-4cde-8f5f-beae5eb48d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.412036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67915095-ae0f-46b6-a895-83fd03cdd389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.412766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915095-ae0f-46b6-a895-83fd03cdd389 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.413108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915095-ae0f-46b6-a895-83fd03cdd389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.413383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915095-ae0f-46b6-a895-83fd03cdd389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.414266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915095-ae0f-46b6-a895-83fd03cdd389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.416046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915095-ae0f-46b6-a895-83fd03cdd389 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.426078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 762/1546] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:57:30.427201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 785/1547] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:57:30.430723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852d453-b1b3-4cde-8f5f-beae5eb48d7a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.451326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852d453-b1b3-4cde-8f5f-beae5eb48d7a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.451581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67915095-ae0f-46b6-a895-83fd03cdd389 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.454812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67915095-ae0f-46b6-a895-83fd03cdd389 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.457637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5311b8-60cc-4852-8847-0f6edbdacc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.458585 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5311b8-60cc-4852-8847-0f6edbdacc9d admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.459147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5311b8-60cc-4852-8847-0f6edbdacc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.460230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5311b8-60cc-4852-8847-0f6edbdacc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.461165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5311b8-60cc-4852-8847-0f6edbdacc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.463901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5311b8-60cc-4852-8847-0f6edbdacc9d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.479695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 763/1548] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:30.483724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5311b8-60cc-4852-8847-0f6edbdacc9d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.488014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d495263-a9ae-401a-9563-fa7541b4c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.488733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d495263-a9ae-401a-9563-fa7541b4c9ac admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.488994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d495263-a9ae-401a-9563-fa7541b4c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.489278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d495263-a9ae-401a-9563-fa7541b4c9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.490030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d495263-a9ae-401a-9563-fa7541b4c9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:30.490373 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d495263-a9ae-401a-9563-fa7541b4c9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.494584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d495263-a9ae-401a-9563-fa7541b4c9ac admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.501509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5311b8-60cc-4852-8847-0f6edbdacc9d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.511563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b82090-55f5-483f-b7a9-f818c11a0e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.512916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82090-55f5-483f-b7a9-f818c11a0e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.513423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82090-55f5-483f-b7a9-f818c11a0e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.513909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82090-55f5-483f-b7a9-f818c11a0e97 admin admin] PATH_INFO: `/v3/projects/2fbf31f703e849cfa03c63580dee547a/users/29349dabed5746449cefe237fd3739c3/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.545052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b82090-55f5-483f-b7a9-f818c11a0e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbf31f703e849cfa03c63580dee547a, user_id=29349dabed5746449cefe237fd3739c3, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.553428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b82090-55f5-483f-b7a9-f818c11a0e97 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.582385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 764/1549] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:30 2022] PUT /identity/v3/projects/2fbf31f703e849cfa03c63580dee547a/users/29349dabed5746449cefe237fd3739c3/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:57:30.585498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602894-fa41-450e-86df-c0eb5ea0fb99 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.586067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602894-fa41-450e-86df-c0eb5ea0fb99 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.586838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602894-fa41-450e-86df-c0eb5ea0fb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.625247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d5602894-fa41-450e-86df-c0eb5ea0fb99 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.626886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d5602894-fa41-450e-86df-c0eb5ea0fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.651694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 786/1550] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:30.651694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31eac2-13af-4e4a-8743-0c9670393cb7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.651694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31eac2-13af-4e4a-8743-0c9670393cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.651694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31eac2-13af-4e4a-8743-0c9670393cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.691078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-6c31eac2-13af-4e4a-8743-0c9670393cb7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.692219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6c31eac2-13af-4e4a-8743-0c9670393cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.717719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 765/1551] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.719488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9421-de22-4bca-a11c-06869b92e4cc None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.720037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9421-de22-4bca-a11c-06869b92e4cc None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.720548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9421-de22-4bca-a11c-06869b92e4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.756724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7afd9421-de22-4bca-a11c-06869b92e4cc None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.763093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7afd9421-de22-4bca-a11c-06869b92e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.781046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 766/1552] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.782912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd9421-de22-4bca-a11c-06869b92e4cc None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.797565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd9421-de22-4bca-a11c-06869b92e4cc None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.803786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 787/1553] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.805418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82db3-2414-4085-a9d3-9553c5883022 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.805935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82db3-2414-4085-a9d3-9553c5883022 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.806430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82db3-2414-4085-a9d3-9553c5883022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.806970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb599e7-8be2-473c-932d-8dd52a57623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.811980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb599e7-8be2-473c-932d-8dd52a57623a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.812458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb599e7-8be2-473c-932d-8dd52a57623a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.812967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb599e7-8be2-473c-932d-8dd52a57623a admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.813985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb599e7-8be2-473c-932d-8dd52a57623a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.816344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb599e7-8be2-473c-932d-8dd52a57623a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.830749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-72b82db3-2414-4085-a9d3-9553c5883022 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.831992 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-72b82db3-2414-4085-a9d3-9553c5883022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.843494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 788/1554] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.843494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d1383-12bc-4bb8-b223-58dad35ddfd0 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.843494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d1383-12bc-4bb8-b223-58dad35ddfd0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.843494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d1383-12bc-4bb8-b223-58dad35ddfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.849166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 767/1555] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:30.850555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156f97-a192-45f4-ab4d-8c385087f54e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.850842 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156f97-a192-45f4-ab4d-8c385087f54e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.851113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156f97-a192-45f4-ab4d-8c385087f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.866015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a69d1383-12bc-4bb8-b223-58dad35ddfd0 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.867217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a69d1383-12bc-4bb8-b223-58dad35ddfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.874100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7e156f97-a192-45f4-ab4d-8c385087f54e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.875331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7e156f97-a192-45f4-ab4d-8c385087f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.924180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 789/1556] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.925667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd786c17-dd30-4967-a562-3054884f523f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.925956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd786c17-dd30-4967-a562-3054884f523f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.926215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd786c17-dd30-4967-a562-3054884f523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.932467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 768/1557] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.932467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef770-2c91-4be4-9126-8283733d1ec3 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.932467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef770-2c91-4be4-9126-8283733d1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.932467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef770-2c91-4be4-9126-8283733d1ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.944938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-cd786c17-dd30-4967-a562-3054884f523f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.946139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-cd786c17-dd30-4967-a562-3054884f523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.952978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-99eef770-2c91-4be4-9126-8283733d1ec3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:30.953883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 790/1558] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.954144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-99eef770-2c91-4be4-9126-8283733d1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:30.954647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd786c17-dd30-4967-a562-3054884f523f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.962438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 769/1559] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:30.964278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eef770-2c91-4be4-9126-8283733d1ec3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:30.973961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eef770-2c91-4be4-9126-8283733d1ec3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:30.979140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:30.979821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:30.980101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:30.980521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:30.981251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:30.981559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:30.982576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING py.warnings [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 18:57:30.982576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: warnings.warn(msg) May 11 18:57:30.982576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: May 11 18:57:30.983490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:30.994918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 770/1560] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:30.995726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.004863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9879461-7fa5-4b72-8a29-703fa06e4267 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.009414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edc053-d365-48e6-a2da-e353f9436bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.009992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc053-d365-48e6-a2da-e353f9436bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.010274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc053-d365-48e6-a2da-e353f9436bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.010552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc053-d365-48e6-a2da-e353f9436bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.010809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd786c17-dd30-4967-a562-3054884f523f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.011289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edc053-d365-48e6-a2da-e353f9436bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.012255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING py.warnings [None req-72edc053-d365-48e6-a2da-e353f9436bf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:57:31.012255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: warnings.warn(msg) May 11 18:57:31.012255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: May 11 18:57:31.013454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edc053-d365-48e6-a2da-e353f9436bf8 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.014507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9cf9-754e-423d-81eb-5eeddd993c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.015148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9cf9-754e-423d-81eb-5eeddd993c7c service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.015471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9cf9-754e-423d-81eb-5eeddd993c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.015741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9cf9-754e-423d-81eb-5eeddd993c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.025587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b9cf9-754e-423d-81eb-5eeddd993c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.027081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b9cf9-754e-423d-81eb-5eeddd993c7c service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.035195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 771/1561] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:30 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.036537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2fbe-d5a4-4189-9588-9a5d86b91025 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.036830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2fbe-d5a4-4189-9588-9a5d86b91025 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.037130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a2fbe-d5a4-4189-9588-9a5d86b91025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.040354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 791/1562] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:31.041699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57de887-881f-4b07-81d9-f6867c1b9c2b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.041991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57de887-881f-4b07-81d9-f6867c1b9c2b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.042267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57de887-881f-4b07-81d9-f6867c1b9c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.055876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-471a2fbe-d5a4-4189-9588-9a5d86b91025 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:31.056993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-471a2fbe-d5a4-4189-9588-9a5d86b91025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:31.060922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c57de887-881f-4b07-81d9-f6867c1b9c2b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:31.062239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c57de887-881f-4b07-81d9-f6867c1b9c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:31.065187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 772/1563] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:31.072820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 792/1564] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:31.074367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ce34-977b-4ef0-8112-12155013223b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.074652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ce34-977b-4ef0-8112-12155013223b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.074925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ce34-977b-4ef0-8112-12155013223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.075581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2fbe-d5a4-4189-9588-9a5d86b91025 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.086141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a2fbe-d5a4-4189-9588-9a5d86b91025 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.090744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.091429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.091713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.091988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.092709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:31.093017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.094017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e9e2ce34-977b-4ef0-8112-12155013223b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:31.094607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.095221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e9e2ce34-977b-4ef0-8112-12155013223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:31.104995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 793/1565] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:31.106013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37817b-40ac-4f2b-b054-09a3cdb2744f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.106317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37817b-40ac-4f2b-b054-09a3cdb2744f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.106560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 773/1566] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:31.106883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37817b-40ac-4f2b-b054-09a3cdb2744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.108415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.121027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b2d3b-8d3d-4842-8c0f-e6c09f6ad826 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.126366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036fa8b-f91f-4baf-9f5b-3b56b2ae3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.126548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-2f37817b-40ac-4f2b-b054-09a3cdb2744f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:31.127034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036fa8b-f91f-4baf-9f5b-3b56b2ae3a7f admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.127318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036fa8b-f91f-4baf-9f5b-3b56b2ae3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.127613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036fa8b-f91f-4baf-9f5b-3b56b2ae3a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.127901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2f37817b-40ac-4f2b-b054-09a3cdb2744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:31.128304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036fa8b-f91f-4baf-9f5b-3b56b2ae3a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.130332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036fa8b-f91f-4baf-9f5b-3b56b2ae3a7f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.137798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 794/1567] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:31.141759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37817b-40ac-4f2b-b054-09a3cdb2744f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.152248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37817b-40ac-4f2b-b054-09a3cdb2744f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.158683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e141d-0dc3-4891-b88e-81fb7e9f60f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.159481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e141d-0dc3-4891-b88e-81fb7e9f60f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.159835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e141d-0dc3-4891-b88e-81fb7e9f60f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.160200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e141d-0dc3-4891-b88e-81fb7e9f60f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.161000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e141d-0dc3-4891-b88e-81fb7e9f60f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.161511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 774/1568] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.162845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e141d-0dc3-4891-b88e-81fb7e9f60f4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.165749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba58b-897f-40a6-9d52-61d2b3548928 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.166027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba58b-897f-40a6-9d52-61d2b3548928 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.166302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba58b-897f-40a6-9d52-61d2b3548928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.174497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 795/1569] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:31.175178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e141d-0dc3-4891-b88e-81fb7e9f60f4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.185016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e141d-0dc3-4891-b88e-81fb7e9f60f4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.187546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-2e7ba58b-897f-40a6-9d52-61d2b3548928 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:31.188963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2e7ba58b-897f-40a6-9d52-61d2b3548928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:31.254212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.254890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.255230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.255534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.256995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:31.257307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.259596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.261886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 775/1570] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:31.262735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ba58b-897f-40a6-9d52-61d2b3548928 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.273947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ba58b-897f-40a6-9d52-61d2b3548928 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.282940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 796/1571] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:31.282940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.284670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.285409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.285695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.285968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.286698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:31.287055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.288955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.300923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e856bd0-6347-498e-b855-b1f822ebbe20 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.304186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 776/1572] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:31.307114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.308776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.310041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.310583 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.311700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.313335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING py.warnings [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:57:31.313335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: warnings.warn(msg) May 11 18:57:31.313335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: May 11 18:57:31.314361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.315830 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.326220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef098be-1de1-4770-8b18-d480fc162f28 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.332541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.333454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.333749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.334147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.334904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:31.335213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.337021 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.353226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 777/1573] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:31.354184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.359047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 797/1574] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.360517 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.373146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768ad6-f81b-4039-b839-b22252c0de3a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.436018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52719d9-d795-4f15-b96f-09fba5cf9b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.436741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b379a9-c12b-4ce1-90ad-49b24e6f6381 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.436931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52719d9-d795-4f15-b96f-09fba5cf9b36 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.437311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52719d9-d795-4f15-b96f-09fba5cf9b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.437699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52719d9-d795-4f15-b96f-09fba5cf9b36 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.438493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52719d9-d795-4f15-b96f-09fba5cf9b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.440620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52719d9-d795-4f15-b96f-09fba5cf9b36 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.442796 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f3f40-f5be-4617-bf75-50c87ac5a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.443851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f3f40-f5be-4617-bf75-50c87ac5a334 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.444576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f3f40-f5be-4617-bf75-50c87ac5a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.444859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f3f40-f5be-4617-bf75-50c87ac5a334 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.445601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f3f40-f5be-4617-bf75-50c87ac5a334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.447362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f3f40-f5be-4617-bf75-50c87ac5a334 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.460804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 798/1575] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:31.461535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f3f40-f5be-4617-bf75-50c87ac5a334 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.465126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 778/1576] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.466230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52719d9-d795-4f15-b96f-09fba5cf9b36 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.473102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f3f40-f5be-4617-bf75-50c87ac5a334 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.479345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.480070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.480354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.480632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.480907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52719d9-d795-4f15-b96f-09fba5cf9b36 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.481368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:31.481796 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.483868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.485884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a4a8-4303-4096-bd46-fd83d3ddd41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.486833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a4a8-4303-4096-bd46-fd83d3ddd41d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.487670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a4a8-4303-4096-bd46-fd83d3ddd41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.487958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a4a8-4303-4096-bd46-fd83d3ddd41d admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.488861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142a4a8-4303-4096-bd46-fd83d3ddd41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.491499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142a4a8-4303-4096-bd46-fd83d3ddd41d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.508660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 799/1577] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:31.509708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.521316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9127d8-f223-4d8a-b63f-f1b445eec6aa admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.528109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 779/1578] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.528327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc60cab-88a0-47a5-8ef3-40fb6bd113e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.528450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a4a8-4303-4096-bd46-fd83d3ddd41d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.528545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc60cab-88a0-47a5-8ef3-40fb6bd113e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.528545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc60cab-88a0-47a5-8ef3-40fb6bd113e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.528545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc60cab-88a0-47a5-8ef3-40fb6bd113e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.529162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc60cab-88a0-47a5-8ef3-40fb6bd113e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.531120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc60cab-88a0-47a5-8ef3-40fb6bd113e2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.566085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 800/1579] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.566911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc60cab-88a0-47a5-8ef3-40fb6bd113e2 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.601498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a4a8-4303-4096-bd46-fd83d3ddd41d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.633165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc60cab-88a0-47a5-8ef3-40fb6bd113e2 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.638487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4d48-c606-4785-8622-cd680bc84753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.639216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4d48-c606-4785-8622-cd680bc84753 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.639533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4d48-c606-4785-8622-cd680bc84753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.639809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4d48-c606-4785-8622-cd680bc84753 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.640748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4d48-c606-4785-8622-cd680bc84753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.643346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4d48-c606-4785-8622-cd680bc84753 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.663076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e484-45d5-4a9a-ade2-4d2bbfa4bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.663777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e484-45d5-4a9a-ade2-4d2bbfa4bee7 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.664059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e484-45d5-4a9a-ade2-4d2bbfa4bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.664333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e484-45d5-4a9a-ade2-4d2bbfa4bee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.668027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 801/1580] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.668027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4d48-c606-4785-8622-cd680bc84753 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7e484-45d5-4a9a-ade2-4d2bbfa4bee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.668273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7e484-45d5-4a9a-ade2-4d2bbfa4bee7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.682497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4d48-c606-4785-8622-cd680bc84753 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.687630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.688552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.688832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.689105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] PATH_INFO: `/v3/projects/1d22bd9d4df840c1af348b3f257593a3/users/c9d83909ea2943f5834778a2a9aa1485/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.696354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 780/1581] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.697673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e484-45d5-4a9a-ade2-4d2bbfa4bee7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.710685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d22bd9d4df840c1af348b3f257593a3, user_id=c9d83909ea2943f5834778a2a9aa1485, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.711769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING py.warnings [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:57:31.711769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: warnings.warn(msg) May 11 18:57:31.711769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: May 11 18:57:31.713687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.728230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 802/1582] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:31 2022] PUT /identity/v3/projects/1d22bd9d4df840c1af348b3f257593a3/users/c9d83909ea2943f5834778a2a9aa1485/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:31.729142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.764199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e484-45d5-4a9a-ade2-4d2bbfa4bee7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.796562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c1c4d-8d95-478b-8dee-c24a62984fb5 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.801267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198beaa-5f35-4a4a-a47e-d56722500f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.802130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198beaa-5f35-4a4a-a47e-d56722500f3b admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.802270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198beaa-5f35-4a4a-a47e-d56722500f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.802454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198beaa-5f35-4a4a-a47e-d56722500f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.803176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198beaa-5f35-4a4a-a47e-d56722500f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.805133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198beaa-5f35-4a4a-a47e-d56722500f3b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.827849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1219-5cef-4b3b-a442-d5f3a783de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.828527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1219-5cef-4b3b-a442-d5f3a783de2d admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.828805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1219-5cef-4b3b-a442-d5f3a783de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.829076 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1219-5cef-4b3b-a442-d5f3a783de2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.829800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1219-5cef-4b3b-a442-d5f3a783de2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.831489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1219-5cef-4b3b-a442-d5f3a783de2d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.840357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 803/1583] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.841142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198beaa-5f35-4a4a-a47e-d56722500f3b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.846600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 781/1584] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:31.846600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1219-5cef-4b3b-a442-d5f3a783de2d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.857564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1219-5cef-4b3b-a442-d5f3a783de2d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.920018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888603f6-c257-4b1a-80a7-7cd7151a467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.920959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888603f6-c257-4b1a-80a7-7cd7151a467d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.921102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888603f6-c257-4b1a-80a7-7cd7151a467d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.921300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888603f6-c257-4b1a-80a7-7cd7151a467d admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.922009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888603f6-c257-4b1a-80a7-7cd7151a467d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.924004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888603f6-c257-4b1a-80a7-7cd7151a467d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.931669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198beaa-5f35-4a4a-a47e-d56722500f3b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.937409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa836-f52d-42fa-a248-a1cb86f7f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.938234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa836-f52d-42fa-a248-a1cb86f7f0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.938571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa836-f52d-42fa-a248-a1cb86f7f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.938922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa836-f52d-42fa-a248-a1cb86f7f0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.939904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fa836-f52d-42fa-a248-a1cb86f7f0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.942108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fa836-f52d-42fa-a248-a1cb86f7f0a1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.947173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 782/1585] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.951001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888603f6-c257-4b1a-80a7-7cd7151a467d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.962192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888603f6-c257-4b1a-80a7-7cd7151a467d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.963948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 804/1586] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:31.967273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad81c8f-3456-4aa4-a2c5-0885bb9eb6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.967697 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa836-f52d-42fa-a248-a1cb86f7f0a1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:31.968105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81c8f-3456-4aa4-a2c5-0885bb9eb6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.968551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81c8f-3456-4aa4-a2c5-0885bb9eb6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.968891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81c8f-3456-4aa4-a2c5-0885bb9eb6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.969686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad81c8f-3456-4aa4-a2c5-0885bb9eb6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.971354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad81c8f-3456-4aa4-a2c5-0885bb9eb6e2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.977205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa836-f52d-42fa-a248-a1cb86f7f0a1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:31.982166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085b9d1-70c7-4d04-aa63-0e71bc59aa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:31.982827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b9d1-70c7-4d04-aa63-0e71bc59aa66 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.983105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b9d1-70c7-4d04-aa63-0e71bc59aa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.983419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b9d1-70c7-4d04-aa63-0e71bc59aa66 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:31.987237 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085b9d1-70c7-4d04-aa63-0e71bc59aa66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:31.987452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 783/1587] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:31.987452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c3f0-0d1f-49a7-ba88-89f3673d406b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:31.987452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c3f0-0d1f-49a7-ba88-89f3673d406b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:31.987708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085b9d1-70c7-4d04-aa63-0e71bc59aa66 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:31.987800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c3f0-0d1f-49a7-ba88-89f3673d406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.004897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-2295c3f0-0d1f-49a7-ba88-89f3673d406b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:32.006773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2295c3f0-0d1f-49a7-ba88-89f3673d406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.007981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 805/1588] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:32.011712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085b9d1-70c7-4d04-aa63-0e71bc59aa66 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.015081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 784/1589] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:32.015928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c3f0-0d1f-49a7-ba88-89f3673d406b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.024397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085b9d1-70c7-4d04-aa63-0e71bc59aa66 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.028050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295c3f0-0d1f-49a7-ba88-89f3673d406b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.030048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f79b-4987-4d03-85e3-5350675a4cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.031259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f79b-4987-4d03-85e3-5350675a4cde admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.031259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f79b-4987-4d03-85e3-5350675a4cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.031539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f79b-4987-4d03-85e3-5350675a4cde admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.032404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f79b-4987-4d03-85e3-5350675a4cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.033889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790d89a-9f15-481b-a795-e5fa82601cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.034550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f79b-4987-4d03-85e3-5350675a4cde admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.034666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790d89a-9f15-481b-a795-e5fa82601cec admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.034821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790d89a-9f15-481b-a795-e5fa82601cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.035096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790d89a-9f15-481b-a795-e5fa82601cec admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.035926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790d89a-9f15-481b-a795-e5fa82601cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.038139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790d89a-9f15-481b-a795-e5fa82601cec admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.051329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 785/1590] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.052253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec0bb5-3ea1-4635-bd75-4b1bc9e4b4ed None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.052531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec0bb5-3ea1-4635-bd75-4b1bc9e4b4ed None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.053413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec0bb5-3ea1-4635-bd75-4b1bc9e4b4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.064255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 806/1591] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/users => generated 284 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:32.064255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f79b-4987-4d03-85e3-5350675a4cde admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.074817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f79b-4987-4d03-85e3-5350675a4cde admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.080208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa448d-90c1-4dea-808c-022e4503ab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.080366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-45ec0bb5-3ea1-4635-bd75-4b1bc9e4b4ed None None] MFA Rules not processed for user `29349dabed5746449cefe237fd3739c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:32.080953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa448d-90c1-4dea-808c-022e4503ab5b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.081302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa448d-90c1-4dea-808c-022e4503ab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.081416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-45ec0bb5-3ea1-4635-bd75-4b1bc9e4b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.081633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa448d-90c1-4dea-808c-022e4503ab5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.082436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa448d-90c1-4dea-808c-022e4503ab5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.084245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa448d-90c1-4dea-808c-022e4503ab5b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.095333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 807/1592] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.099034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa448d-90c1-4dea-808c-022e4503ab5b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.109747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa448d-90c1-4dea-808c-022e4503ab5b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.114375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee1aab-3c12-4aeb-8cc8-67143092d872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.115037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee1aab-3c12-4aeb-8cc8-67143092d872 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.115934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee1aab-3c12-4aeb-8cc8-67143092d872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.116468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee1aab-3c12-4aeb-8cc8-67143092d872 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.117204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee1aab-3c12-4aeb-8cc8-67143092d872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.118803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee1aab-3c12-4aeb-8cc8-67143092d872 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.128949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 808/1593] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.129773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee1aab-3c12-4aeb-8cc8-67143092d872 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.139711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee1aab-3c12-4aeb-8cc8-67143092d872 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.144220 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.144865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.145142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.145413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.146121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.147827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.152911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 786/1594] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:32.153821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec0bb5-3ea1-4635-bd75-4b1bc9e4b4ed None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.158089 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 809/1595] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.159061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.164890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.171972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec0bb5-3ea1-4635-bd75-4b1bc9e4b4ed None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.176400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf5b8e-f6f3-4757-b2fd-d6b659c4ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.177056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf5b8e-f6f3-4757-b2fd-d6b659c4ec30 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.177329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf5b8e-f6f3-4757-b2fd-d6b659c4ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.177599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf5b8e-f6f3-4757-b2fd-d6b659c4ec30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.178920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf5b8e-f6f3-4757-b2fd-d6b659c4ec30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.180536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf5b8e-f6f3-4757-b2fd-d6b659c4ec30 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.193241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 787/1596] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.193241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf5b8e-f6f3-4757-b2fd-d6b659c4ec30 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.200987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf5b8e-f6f3-4757-b2fd-d6b659c4ec30 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.208841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266c1e-b786-4fed-adc7-215910ceb628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.210246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266c1e-b786-4fed-adc7-215910ceb628 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.210523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266c1e-b786-4fed-adc7-215910ceb628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.210792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266c1e-b786-4fed-adc7-215910ceb628 admin admin] PATH_INFO: `/v3/projects/286035250ee843e696e2422db9319f4f/users/f1f10686b4814794aadc34ec6194cc6b/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.222919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c734ef-6215-483c-8637-ea75f9d99c42 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.225742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2266c1e-b786-4fed-adc7-215910ceb628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286035250ee843e696e2422db9319f4f, user_id=f1f10686b4814794aadc34ec6194cc6b, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.227126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8e74d-a0dd-4e3d-b081-a90a2424f8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.227812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e74d-a0dd-4e3d-b081-a90a2424f8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.228115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e74d-a0dd-4e3d-b081-a90a2424f8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.228391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e74d-a0dd-4e3d-b081-a90a2424f8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.228504 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2266c1e-b786-4fed-adc7-215910ceb628 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.237857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8e74d-a0dd-4e3d-b081-a90a2424f8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.239317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8e74d-a0dd-4e3d-b081-a90a2424f8c0 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.244761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 788/1597] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:32 2022] PUT /identity/v3/projects/286035250ee843e696e2422db9319f4f/users/f1f10686b4814794aadc34ec6194cc6b/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:32.244761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266c1e-b786-4fed-adc7-215910ceb628 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.249022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 810/1598] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:32.249810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8e74d-a0dd-4e3d-b081-a90a2424f8c0 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.258956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8e74d-a0dd-4e3d-b081-a90a2424f8c0 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.309169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266c1e-b786-4fed-adc7-215910ceb628 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.314630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432028d-2c41-4035-950b-38825740e2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.315307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432028d-2c41-4035-950b-38825740e2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.315610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432028d-2c41-4035-950b-38825740e2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.315885 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432028d-2c41-4035-950b-38825740e2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.316620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432028d-2c41-4035-950b-38825740e2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.318416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432028d-2c41-4035-950b-38825740e2ef admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.329918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b49f7d-862c-41fc-8d37-c2cdc6915ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.333333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 789/1599] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.333480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49f7d-862c-41fc-8d37-c2cdc6915ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.333480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49f7d-862c-41fc-8d37-c2cdc6915ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.333480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49f7d-862c-41fc-8d37-c2cdc6915ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.333755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432028d-2c41-4035-950b-38825740e2ef admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.333855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b49f7d-862c-41fc-8d37-c2cdc6915ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.334479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b49f7d-862c-41fc-8d37-c2cdc6915ebe admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.341770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432028d-2c41-4035-950b-38825740e2ef admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.346304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 811/1600] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.347614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1c81-0eac-4d6f-a449-43e88a176bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.348265 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1c81-0eac-4d6f-a449-43e88a176bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.348543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1c81-0eac-4d6f-a449-43e88a176bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.348817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1c81-0eac-4d6f-a449-43e88a176bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.349541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e1c81-0eac-4d6f-a449-43e88a176bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.351007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b49f7d-862c-41fc-8d37-c2cdc6915ebe admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.351922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e1c81-0eac-4d6f-a449-43e88a176bc6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.362020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b49f7d-862c-41fc-8d37-c2cdc6915ebe admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.364106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 790/1601] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.365257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b3e70-116d-447d-91dd-48b72c456681 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.365542 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b3e70-116d-447d-91dd-48b72c456681 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.365817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b3e70-116d-447d-91dd-48b72c456681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.369875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c649a-8ebd-43a8-bc78-e33712f1fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.371454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c649a-8ebd-43a8-bc78-e33712f1fba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.371735 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c649a-8ebd-43a8-bc78-e33712f1fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.372006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c649a-8ebd-43a8-bc78-e33712f1fba9 admin admin] PATH_INFO: `/v3/projects/35ad10e77d194397ba6a84cf39758839/users/f8edf1e5f81c4e81b346c82cb48a47f6/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.386887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-3b4b3e70-116d-447d-91dd-48b72c456681 None None] MFA Rules not processed for user `29349dabed5746449cefe237fd3739c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:32.388238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3b4b3e70-116d-447d-91dd-48b72c456681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.388381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c649a-8ebd-43a8-bc78-e33712f1fba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ad10e77d194397ba6a84cf39758839, user_id=f8edf1e5f81c4e81b346c82cb48a47f6, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.391899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c649a-8ebd-43a8-bc78-e33712f1fba9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.406856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 812/1602] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:32 2022] PUT /identity/v3/projects/35ad10e77d194397ba6a84cf39758839/users/f8edf1e5f81c4e81b346c82cb48a47f6/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:32.408011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c649a-8ebd-43a8-bc78-e33712f1fba9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.456292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 791/1603] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:32.456292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fab5ee-d4ce-40c7-8334-36c12ad73b78 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.456292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fab5ee-d4ce-40c7-8334-36c12ad73b78 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.456292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fab5ee-d4ce-40c7-8334-36c12ad73b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.474590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-27fab5ee-d4ce-40c7-8334-36c12ad73b78 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:32.477277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-27fab5ee-d4ce-40c7-8334-36c12ad73b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.484596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c649a-8ebd-43a8-bc78-e33712f1fba9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.487503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 792/1604] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:32.487503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fab5ee-d4ce-40c7-8334-36c12ad73b78 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.497126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fab5ee-d4ce-40c7-8334-36c12ad73b78 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.500275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718d3d5-a475-4afe-bf85-22d726adcc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.501065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718d3d5-a475-4afe-bf85-22d726adcc95 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.501866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718d3d5-a475-4afe-bf85-22d726adcc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.501866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718d3d5-a475-4afe-bf85-22d726adcc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.502437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602a761-8653-4bcd-8d90-1af9432ffba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.502748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718d3d5-a475-4afe-bf85-22d726adcc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.503271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602a761-8653-4bcd-8d90-1af9432ffba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.503590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602a761-8653-4bcd-8d90-1af9432ffba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.503865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602a761-8653-4bcd-8d90-1af9432ffba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.504880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602a761-8653-4bcd-8d90-1af9432ffba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.504997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718d3d5-a475-4afe-bf85-22d726adcc95 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.506597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602a761-8653-4bcd-8d90-1af9432ffba3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.516711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 813/1605] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.518053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718d3d5-a475-4afe-bf85-22d726adcc95 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.520335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 793/1606] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:32.521195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602a761-8653-4bcd-8d90-1af9432ffba3 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.529812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718d3d5-a475-4afe-bf85-22d726adcc95 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.531189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602a761-8653-4bcd-8d90-1af9432ffba3 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.534436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650ac77-8e26-4e45-a1cb-0121cbcb89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.535404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ac77-8e26-4e45-a1cb-0121cbcb89a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.535622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ac77-8e26-4e45-a1cb-0121cbcb89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.536259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ac77-8e26-4e45-a1cb-0121cbcb89a1 admin admin] PATH_INFO: `/v3/projects/9e2d6a4c01b04940b13d9f1ca40bd778/users/378aab35909343d88c0250493e41be34/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.537838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1824a-dba3-4180-ab31-59c84857cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.539342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1824a-dba3-4180-ab31-59c84857cd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.540559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1824a-dba3-4180-ab31-59c84857cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.540948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1824a-dba3-4180-ab31-59c84857cd2a admin admin] PATH_INFO: `/v3/projects/2823ee02ad764906b041f1ff9504a955/users/8144879929e94220b001b5bd334629b3/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.552321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ac77-8e26-4e45-a1cb-0121cbcb89a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2d6a4c01b04940b13d9f1ca40bd778, user_id=378aab35909343d88c0250493e41be34, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.555117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ac77-8e26-4e45-a1cb-0121cbcb89a1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.560941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1824a-dba3-4180-ab31-59c84857cd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2823ee02ad764906b041f1ff9504a955, user_id=8144879929e94220b001b5bd334629b3, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.564081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1824a-dba3-4180-ab31-59c84857cd2a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.574338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 814/1607] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:32 2022] PUT /identity/v3/projects/9e2d6a4c01b04940b13d9f1ca40bd778/users/378aab35909343d88c0250493e41be34/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:32.575843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bef1d-426e-4425-a388-3e23229d8586 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.576126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bef1d-426e-4425-a388-3e23229d8586 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.576484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bef1d-426e-4425-a388-3e23229d8586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.584732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 794/1608] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:32 2022] PUT /identity/v3/projects/2823ee02ad764906b041f1ff9504a955/users/8144879929e94220b001b5bd334629b3/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:32.588179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eee7c5-50a4-4604-9bbb-b42f664ccecb None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.588467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eee7c5-50a4-4604-9bbb-b42f664ccecb None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.588744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eee7c5-50a4-4604-9bbb-b42f664ccecb None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.593478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 795/1609] 10.222.0.93 () {54 vars in 961 bytes} [Wed May 11 18:57:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:57:32.594486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eee7c5-50a4-4604-9bbb-b42f664ccecb None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.601994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7a2bef1d-426e-4425-a388-3e23229d8586 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:32.603211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7a2bef1d-426e-4425-a388-3e23229d8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.670568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eee7c5-50a4-4604-9bbb-b42f664ccecb None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.674778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16bcad-fe70-4a21-a00f-8f1d2fee0388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.675479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16bcad-fe70-4a21-a00f-8f1d2fee0388 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.675890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16bcad-fe70-4a21-a00f-8f1d2fee0388 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.676772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16bcad-fe70-4a21-a00f-8f1d2fee0388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.679121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 815/1610] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:32.680654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bef1d-426e-4425-a388-3e23229d8586 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.692843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bef1d-426e-4425-a388-3e23229d8586 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.696223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16bcad-fe70-4a21-a00f-8f1d2fee0388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.698774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16bcad-fe70-4a21-a00f-8f1d2fee0388 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.699901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a75694-0e7e-4845-b8e1-a46b88d732ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.700928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a75694-0e7e-4845-b8e1-a46b88d732ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.701356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a75694-0e7e-4845-b8e1-a46b88d732ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.701733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a75694-0e7e-4845-b8e1-a46b88d732ab admin admin] PATH_INFO: `/v3/projects/5bc1e0447fab4adcafaf48de56af2eea/users/9e32dc69c3114cd7960308b1d7fd3c86/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.714164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 796/1611] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:32.715364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16bcad-fe70-4a21-a00f-8f1d2fee0388 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.723802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a75694-0e7e-4845-b8e1-a46b88d732ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc1e0447fab4adcafaf48de56af2eea, user_id=9e32dc69c3114cd7960308b1d7fd3c86, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.727209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16bcad-fe70-4a21-a00f-8f1d2fee0388 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.727580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a75694-0e7e-4845-b8e1-a46b88d732ab admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.732994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5acd92-809a-49b3-ac1d-b1ac730ff0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.734227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5acd92-809a-49b3-ac1d-b1ac730ff0f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.734375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5acd92-809a-49b3-ac1d-b1ac730ff0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.734605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5acd92-809a-49b3-ac1d-b1ac730ff0f4 admin admin] PATH_INFO: `/v3/projects/78314e347f7c41cb9128630dd0d980bc/users/2f70bffe4dfe48d6a1efc2e471b05a3f/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.750287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 816/1612] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:32 2022] PUT /identity/v3/projects/5bc1e0447fab4adcafaf48de56af2eea/users/9e32dc69c3114cd7960308b1d7fd3c86/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:32.752855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66ae1-ad72-4f97-9fe8-dfdaffa458c7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.753323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66ae1-ad72-4f97-9fe8-dfdaffa458c7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.753806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66ae1-ad72-4f97-9fe8-dfdaffa458c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.757686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5acd92-809a-49b3-ac1d-b1ac730ff0f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78314e347f7c41cb9128630dd0d980bc, user_id=2f70bffe4dfe48d6a1efc2e471b05a3f, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.762307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5acd92-809a-49b3-ac1d-b1ac730ff0f4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.776259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-25b66ae1-ad72-4f97-9fe8-dfdaffa458c7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:32.778138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-25b66ae1-ad72-4f97-9fe8-dfdaffa458c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.778874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 797/1613] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:32 2022] PUT /identity/v3/projects/78314e347f7c41cb9128630dd0d980bc/users/2f70bffe4dfe48d6a1efc2e471b05a3f/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:32.780386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831297e-9458-4832-bc54-ba15fd07a65a None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.780625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831297e-9458-4832-bc54-ba15fd07a65a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.781081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831297e-9458-4832-bc54-ba15fd07a65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.809644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c831297e-9458-4832-bc54-ba15fd07a65a None None] MFA Rules not processed for user `8144879929e94220b001b5bd334629b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:32.810857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c831297e-9458-4832-bc54-ba15fd07a65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.862117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 817/1614] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:32.863711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44047-6d77-40a9-aed2-57679be646c8 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.863922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44047-6d77-40a9-aed2-57679be646c8 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.864283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44047-6d77-40a9-aed2-57679be646c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.885710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3bb44047-6d77-40a9-aed2-57679be646c8 None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:32.887108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3bb44047-6d77-40a9-aed2-57679be646c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:32.894931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 798/1615] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:32.894931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831297e-9458-4832-bc54-ba15fd07a65a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:32.960365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831297e-9458-4832-bc54-ba15fd07a65a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:32.964813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28785fe-4c10-462d-81d7-9b557f0ee337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:32.965541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28785fe-4c10-462d-81d7-9b557f0ee337 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.965893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28785fe-4c10-462d-81d7-9b557f0ee337 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.966316 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28785fe-4c10-462d-81d7-9b557f0ee337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.976085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28785fe-4c10-462d-81d7-9b557f0ee337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:32.977590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28785fe-4c10-462d-81d7-9b557f0ee337 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:32.983499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 818/1616] 10.222.0.93 () {58 vars in 1058 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:32.985468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807145bd-78e5-455e-818b-73670dab6d92 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.985969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807145bd-78e5-455e-818b-73670dab6d92 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.986364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807145bd-78e5-455e-818b-73670dab6d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:32.988727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 799/1617] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:32.990133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f234ef-ed18-42f2-89ff-82924791052f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:32.990971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f234ef-ed18-42f2-89ff-82924791052f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:32.991352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f234ef-ed18-42f2-89ff-82924791052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.019801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-807145bd-78e5-455e-818b-73670dab6d92 None None] MFA Rules not processed for user `9e32dc69c3114cd7960308b1d7fd3c86`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:33.021030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-807145bd-78e5-455e-818b-73670dab6d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:33.032117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-57f234ef-ed18-42f2-89ff-82924791052f None None] MFA Rules not processed for user `2f70bffe4dfe48d6a1efc2e471b05a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:33.034473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-57f234ef-ed18-42f2-89ff-82924791052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:33.153345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 819/1618] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:33.154224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807145bd-78e5-455e-818b-73670dab6d92 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:33.169393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807145bd-78e5-455e-818b-73670dab6d92 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:33.184940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f24c8-b4f1-4394-9bd3-4f919af995c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:33.185604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f24c8-b4f1-4394-9bd3-4f919af995c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:33.185878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f24c8-b4f1-4394-9bd3-4f919af995c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:33.186147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f24c8-b4f1-4394-9bd3-4f919af995c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.207309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 800/1619] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:33.209870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da778-466b-4780-a94e-27d49a0cfb17 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:33.210784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da778-466b-4780-a94e-27d49a0cfb17 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:33.211069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da778-466b-4780-a94e-27d49a0cfb17 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.212480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 801/1620] 10.222.0.93 () {54 vars in 961 bytes} [Wed May 11 18:57:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:57:33.213176 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41da778-466b-4780-a94e-27d49a0cfb17 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:33.216789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f24c8-b4f1-4394-9bd3-4f919af995c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:33.218232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f24c8-b4f1-4394-9bd3-4f919af995c9 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:33.260778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 820/1621] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:33.268691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41da778-466b-4780-a94e-27d49a0cfb17 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:33.272926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61e0c-b9f8-4e57-ac8a-33f663b94fda None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:33.273688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61e0c-b9f8-4e57-ac8a-33f663b94fda None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:33.275391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61e0c-b9f8-4e57-ac8a-33f663b94fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.275530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4954b2-ed3b-43fb-88cf-87334c3679f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:33.276143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4954b2-ed3b-43fb-88cf-87334c3679f6 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:33.276464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4954b2-ed3b-43fb-88cf-87334c3679f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:33.276986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4954b2-ed3b-43fb-88cf-87334c3679f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.301885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-01f61e0c-b9f8-4e57-ac8a-33f663b94fda None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:33.304438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-01f61e0c-b9f8-4e57-ac8a-33f663b94fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:33.326396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 821/1622] 10.222.0.93 () {58 vars in 1058 bytes} [Wed May 11 18:57:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:33.328349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f61e0c-b9f8-4e57-ac8a-33f663b94fda None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:33.362435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4954b2-ed3b-43fb-88cf-87334c3679f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:33.364966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4954b2-ed3b-43fb-88cf-87334c3679f6 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:33.378863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 802/1623] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:33.379861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4954b2-ed3b-43fb-88cf-87334c3679f6 service nova] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:33.394414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4954b2-ed3b-43fb-88cf-87334c3679f6 service nova] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:33.394857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f61e0c-b9f8-4e57-ac8a-33f663b94fda None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:33.401083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118e3a9-2bb7-44bd-97b1-ff471b653c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:33.401847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118e3a9-2bb7-44bd-97b1-ff471b653c0b service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:33.402185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118e3a9-2bb7-44bd-97b1-ff471b653c0b service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:33.402465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118e3a9-2bb7-44bd-97b1-ff471b653c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.405292 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b618b-eeea-4405-9892-8b93fbb83c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:33.407685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b618b-eeea-4405-9892-8b93fbb83c47 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:33.408084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b618b-eeea-4405-9892-8b93fbb83c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:33.408495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b618b-eeea-4405-9892-8b93fbb83c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.412548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118e3a9-2bb7-44bd-97b1-ff471b653c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:33.414560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118e3a9-2bb7-44bd-97b1-ff471b653c0b service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:33.424734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b618b-eeea-4405-9892-8b93fbb83c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:33.426786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 803/1624] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:33.438802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b618b-eeea-4405-9892-8b93fbb83c47 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:33.476850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 822/1625] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:33.879898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da683-ea31-4da3-8fdd-61b4ac2bee60 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:33.880393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da683-ea31-4da3-8fdd-61b4ac2bee60 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:33.880787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da683-ea31-4da3-8fdd-61b4ac2bee60 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.883537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 804/1626] 10.222.0.93 () {54 vars in 912 bytes} [Wed May 11 18:57:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:57:33.906595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72986-e087-4887-8938-1642b655f319 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:33.906882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72986-e087-4887-8938-1642b655f319 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:33.907188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72986-e087-4887-8938-1642b655f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:33.957390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e5d72986-e087-4887-8938-1642b655f319 None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:33.964809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e5d72986-e087-4887-8938-1642b655f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:33.970187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00da683-ea31-4da3-8fdd-61b4ac2bee60 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:33.988770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00da683-ea31-4da3-8fdd-61b4ac2bee60 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:33.995816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 823/1627] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:57:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:34.001188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f96c71-3066-45c9-b903-2d6224ea8cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:34.003041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96c71-3066-45c9-b903-2d6224ea8cb5 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:34.003041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96c71-3066-45c9-b903-2d6224ea8cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:34.003890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96c71-3066-45c9-b903-2d6224ea8cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:34.010204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72986-e087-4887-8938-1642b655f319 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:34.011962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e5d72986-e087-4887-8938-1642b655f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:34.015891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f96c71-3066-45c9-b903-2d6224ea8cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:34.018101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f96c71-3066-45c9-b903-2d6224ea8cb5 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:34.043869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 805/1628] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:34.080460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c6907-1830-4200-bfce-109dd5231556 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:34.081161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c6907-1830-4200-bfce-109dd5231556 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:34.082504 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c6907-1830-4200-bfce-109dd5231556 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:34.085435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 806/1629] 10.222.0.93 () {54 vars in 912 bytes} [Wed May 11 18:57:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:57:34.092566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca76cc-4cc5-42dd-9eef-23e49b11a40f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:34.093642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca76cc-4cc5-42dd-9eef-23e49b11a40f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:34.094189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca76cc-4cc5-42dd-9eef-23e49b11a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:34.118589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-37ca76cc-4cc5-42dd-9eef-23e49b11a40f None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:34.121240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-37ca76cc-4cc5-42dd-9eef-23e49b11a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:34.131023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72986-e087-4887-8938-1642b655f319 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:34.139890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 807/1630] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:57:34.147001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02504358-9b0f-4896-bd3c-566a5b95ebd4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:34.148063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504358-9b0f-4896-bd3c-566a5b95ebd4 service glance] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:34.148515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504358-9b0f-4896-bd3c-566a5b95ebd4 service glance] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:34.148734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca76cc-4cc5-42dd-9eef-23e49b11a40f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:34.148949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504358-9b0f-4896-bd3c-566a5b95ebd4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:34.159892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca76cc-4cc5-42dd-9eef-23e49b11a40f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:34.165443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3203fac-15fe-48bc-b5d9-75651bb60ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:34.166596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3203fac-15fe-48bc-b5d9-75651bb60ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:34.167480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3203fac-15fe-48bc-b5d9-75651bb60ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:34.168162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3203fac-15fe-48bc-b5d9-75651bb60ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:34.176383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02504358-9b0f-4896-bd3c-566a5b95ebd4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:34.181868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02504358-9b0f-4896-bd3c-566a5b95ebd4 service glance] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:34.182681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3203fac-15fe-48bc-b5d9-75651bb60ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:34.184584 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3203fac-15fe-48bc-b5d9-75651bb60ce8 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:34.213014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 808/1631] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:34.228348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 824/1632] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:34.937320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e069-b0f1-45d9-913c-bc66f906ad12 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:34.937630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e069-b0f1-45d9-913c-bc66f906ad12 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:34.937950 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e069-b0f1-45d9-913c-bc66f906ad12 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:34.939785 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 809/1633] 10.222.0.93 () {54 vars in 912 bytes} [Wed May 11 18:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:57:34.946880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178c1d-193f-4841-8807-258aa9554e86 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:34.947167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178c1d-193f-4841-8807-258aa9554e86 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:34.947514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178c1d-193f-4841-8807-258aa9554e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:34.998278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-31178c1d-193f-4841-8807-258aa9554e86 None None] MFA Rules not processed for user `af0204b62913420a90303c42dbded7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:34.999635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-31178c1d-193f-4841-8807-258aa9554e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:35.008008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 825/1634] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:35.050745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986e069-b0f1-45d9-913c-bc66f906ad12 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:35.072741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986e069-b0f1-45d9-913c-bc66f906ad12 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:35.081235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce0263-0b13-4ba0-bc81-cc8f81c1c7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:35.082479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0263-0b13-4ba0-bc81-cc8f81c1c7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:35.082865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0263-0b13-4ba0-bc81-cc8f81c1c7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:35.083069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0263-0b13-4ba0-bc81-cc8f81c1c7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:35.096623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce0263-0b13-4ba0-bc81-cc8f81c1c7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:35.103653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce0263-0b13-4ba0-bc81-cc8f81c1c7c2 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:35.124172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 810/1635] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:35.621647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31178c1d-193f-4841-8807-258aa9554e86 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:35.642779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31178c1d-193f-4841-8807-258aa9554e86 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:35.648557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:35.649734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:35.650642 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:35.651136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] PATH_INFO: `/v3/users/8144879929e94220b001b5bd334629b3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:35.652857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8144879929e94220b001b5bd334629b3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:35.654183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: WARNING py.warnings [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:57:35.654183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: warnings.warn(msg) May 11 18:57:35.654183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: May 11 18:57:35.656578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:35.742059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8144879929e94220b001b5bd334629b3'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:35.756915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8144879929e94220b001b5bd334629b3'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:35.773864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8144879929e94220b001b5bd334629b3'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:35.776144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8144879929e94220b001b5bd334629b3'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:35.851429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8144879929e94220b001b5bd334629b3'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:35.863221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 826/1636] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:57:35 2022] DELETE /identity/v3/users/8144879929e94220b001b5bd334629b3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:35.866296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e41e79-57a6-4a14-bde3-aac4f571b596 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:35.866864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e41e79-57a6-4a14-bde3-aac4f571b596 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:35.867351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e41e79-57a6-4a14-bde3-aac4f571b596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:35.904592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-91e41e79-57a6-4a14-bde3-aac4f571b596 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:35.912232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-91e41e79-57a6-4a14-bde3-aac4f571b596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:36.049929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 811/1637] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:36.086309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:36.088247 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:36.240999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab179c-19f4-46bf-b6d0-3bbf35dcd8e0 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:36.246290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d101b0-727f-45a5-baf0-7ca776beb136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:36.247055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d101b0-727f-45a5-baf0-7ca776beb136 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:36.247447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d101b0-727f-45a5-baf0-7ca776beb136 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:36.247790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d101b0-727f-45a5-baf0-7ca776beb136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:36.262844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d101b0-727f-45a5-baf0-7ca776beb136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:36.263271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a120c-4434-4529-81d1-a3b7536e2c33 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:36.263594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a120c-4434-4529-81d1-a3b7536e2c33 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:36.263876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a120c-4434-4529-81d1-a3b7536e2c33 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:36.264804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d101b0-727f-45a5-baf0-7ca776beb136 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:36.265287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 812/1638] 10.222.0.93 () {54 vars in 960 bytes} [Wed May 11 18:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 18:57:36.271216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e58f-d9c8-4d68-8c86-63b564ac8fa1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:36.272268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e58f-d9c8-4d68-8c86-63b564ac8fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:36.272622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e58f-d9c8-4d68-8c86-63b564ac8fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:36.278791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 827/1639] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:36.297435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-3638e58f-d9c8-4d68-8c86-63b564ac8fa1 None None] MFA Rules not processed for user `911d21a666844fc399286e24c2892184`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:36.298897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3638e58f-d9c8-4d68-8c86-63b564ac8fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:36.382576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 813/1640] 10.222.0.93 () {58 vars in 1057 bytes} [Wed May 11 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:57:36.383519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d101b0-727f-45a5-baf0-7ca776beb136 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:36.404499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d101b0-727f-45a5-baf0-7ca776beb136 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:36.413600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41972a3-00c5-4135-995c-fce09e8454e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '911d21a666844fc399286e24c2892184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:36.414976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41972a3-00c5-4135-995c-fce09e8454e8 service placement] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:36.416528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41972a3-00c5-4135-995c-fce09e8454e8 service placement] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:36.416898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41972a3-00c5-4135-995c-fce09e8454e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:36.423276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c41972a3-00c5-4135-995c-fce09e8454e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:36.457515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41972a3-00c5-4135-995c-fce09e8454e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:36.462038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41972a3-00c5-4135-995c-fce09e8454e8 service placement] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:36.482123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 828/1641] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:39.025048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638e58f-d9c8-4d68-8c86-63b564ac8fa1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:39.025048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3638e58f-d9c8-4d68-8c86-63b564ac8fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:39.056469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638e58f-d9c8-4d68-8c86-63b564ac8fa1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:39.062152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:39.063598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:39.063598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:39.063849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] PATH_INFO: `/v3/projects/2823ee02ad764906b041f1ff9504a955` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:39.066567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2823ee02ad764906b041f1ff9504a955)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:39.067728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: WARNING py.warnings [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 18:57:39.067728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: warnings.warn(msg) May 11 18:57:39.067728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: May 11 18:57:39.097311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:39.220849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2823ee02ad764906b041f1ff9504a955', 'request_id': 'req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:39.228587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2823ee02ad764906b041f1ff9504a955', 'request_id': 'req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:39.248089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2823ee02ad764906b041f1ff9504a955', 'request_id': 'req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:39.284680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] The token cache is being invalidate because project 2823ee02ad764906b041f1ff9504a955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:57:39.285065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:39.286228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-adb4ce14-b9cf-447a-9a2a-3d97eda3539f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:39.288694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 814/1642] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:57:39 2022] DELETE /identity/v3/projects/2823ee02ad764906b041f1ff9504a955 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:39.293453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275856-ab73-4bbd-b16c-d70f09a8047d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:39.294606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275856-ab73-4bbd-b16c-d70f09a8047d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:39.294958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275856-ab73-4bbd-b16c-d70f09a8047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:39.319822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-88275856-ab73-4bbd-b16c-d70f09a8047d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:39.336051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-88275856-ab73-4bbd-b16c-d70f09a8047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:39.468251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 829/1643] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:39.476763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cab8-0c35-43c2-8993-37356da5ea36 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:39.477308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cab8-0c35-43c2-8993-37356da5ea36 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:39.477703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cab8-0c35-43c2-8993-37356da5ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:39.499334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9c24cab8-0c35-43c2-8993-37356da5ea36 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:39.501153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9c24cab8-0c35-43c2-8993-37356da5ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:39.511197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 815/1644] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:39.515157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275856-ab73-4bbd-b16c-d70f09a8047d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:39.526439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275856-ab73-4bbd-b16c-d70f09a8047d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:39.533229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:39.534188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:39.534673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:39.535145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:39.536143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:39.537803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:39.539859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:39.556298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 830/1645] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:39.560494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24cab8-0c35-43c2-8993-37356da5ea36 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:39.575550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24cab8-0c35-43c2-8993-37356da5ea36 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:39.590379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3888c-cd18-4720-8b21-48e2c3df7edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:39.591473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3888c-cd18-4720-8b21-48e2c3df7edd admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:39.591973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3888c-cd18-4720-8b21-48e2c3df7edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:39.592628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3888c-cd18-4720-8b21-48e2c3df7edd admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:39.593538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3888c-cd18-4720-8b21-48e2c3df7edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:39.604387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3888c-cd18-4720-8b21-48e2c3df7edd admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:39.658754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 816/1646] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:39 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:39.663523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:39.676931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5751a6-f061-42e8-a9d9-7d8b34d78ad8 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:39.814067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446c0f-8570-4081-a7d3-e484238a9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:39.814978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446c0f-8570-4081-a7d3-e484238a9743 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:39.815081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446c0f-8570-4081-a7d3-e484238a9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:39.815332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446c0f-8570-4081-a7d3-e484238a9743 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:39.816031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61446c0f-8570-4081-a7d3-e484238a9743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:39.817995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61446c0f-8570-4081-a7d3-e484238a9743 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:39.858798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 831/1647] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:39 2022] POST /identity/v3/users => generated 279 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:39.863206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3888c-cd18-4720-8b21-48e2c3df7edd admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:39.877325 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3888c-cd18-4720-8b21-48e2c3df7edd admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:39.884463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7d3f-de58-4e12-85ca-73c5c175c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:39.885802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7d3f-de58-4e12-85ca-73c5c175c4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:39.886303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7d3f-de58-4e12-85ca-73c5c175c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:39.886784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7d3f-de58-4e12-85ca-73c5c175c4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:39.887786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d7d3f-de58-4e12-85ca-73c5c175c4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:39.889983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d7d3f-de58-4e12-85ca-73c5c175c4c1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:39.918125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 817/1648] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:39.922795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446c0f-8570-4081-a7d3-e484238a9743 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:39.936597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446c0f-8570-4081-a7d3-e484238a9743 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:39.951936 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37d774-552c-427a-ba68-e6b52fb4042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:39.952744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37d774-552c-427a-ba68-e6b52fb4042c admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:39.953501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37d774-552c-427a-ba68-e6b52fb4042c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:39.953501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37d774-552c-427a-ba68-e6b52fb4042c admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:39.954141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37d774-552c-427a-ba68-e6b52fb4042c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:39.955810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37d774-552c-427a-ba68-e6b52fb4042c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:39.993430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 832/1649] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:39.997943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7d3f-de58-4e12-85ca-73c5c175c4c1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:40.024308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7d3f-de58-4e12-85ca-73c5c175c4c1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:40.029574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab26b0-e28a-4855-8de6-7ffddfc0b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:40.030558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab26b0-e28a-4855-8de6-7ffddfc0b0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:40.030838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab26b0-e28a-4855-8de6-7ffddfc0b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:40.031259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab26b0-e28a-4855-8de6-7ffddfc0b0d6 admin admin] PATH_INFO: `/v3/projects/5d9c0f0627c647e589ff4636c66a592d/users/a893791b346b431fb57a25c306663846/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:40.071233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab26b0-e28a-4855-8de6-7ffddfc0b0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9c0f0627c647e589ff4636c66a592d, user_id=a893791b346b431fb57a25c306663846, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:40.074610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab26b0-e28a-4855-8de6-7ffddfc0b0d6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:40.102442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 818/1650] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:39 2022] PUT /identity/v3/projects/5d9c0f0627c647e589ff4636c66a592d/users/a893791b346b431fb57a25c306663846/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:40.116400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069668-7fa4-488f-a86b-0e0b2766893d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:40.117429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069668-7fa4-488f-a86b-0e0b2766893d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:40.117840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069668-7fa4-488f-a86b-0e0b2766893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:40.173904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-ef069668-7fa4-488f-a86b-0e0b2766893d None None] MFA Rules not processed for user `a893791b346b431fb57a25c306663846`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:40.184259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ef069668-7fa4-488f-a86b-0e0b2766893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:40.367939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 833/1651] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:40.372235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab26b0-e28a-4855-8de6-7ffddfc0b0d6 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:40.502174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab26b0-e28a-4855-8de6-7ffddfc0b0d6 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:40.508146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100364c-e639-4d6a-aca2-502a913be803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:40.509891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100364c-e639-4d6a-aca2-502a913be803 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:40.510412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100364c-e639-4d6a-aca2-502a913be803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:40.510797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100364c-e639-4d6a-aca2-502a913be803 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:40.512007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100364c-e639-4d6a-aca2-502a913be803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:40.514290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100364c-e639-4d6a-aca2-502a913be803 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:40.586196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 819/1652] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:40 2022] POST /identity/v3/projects => generated 355 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:40.589683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef069668-7fa4-488f-a86b-0e0b2766893d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:40.641719 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef069668-7fa4-488f-a86b-0e0b2766893d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:40.789910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2f37-ea63-4a15-8685-a871a65f4091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:40.790962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2f37-ea63-4a15-8685-a871a65f4091 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:40.791549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2f37-ea63-4a15-8685-a871a65f4091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:40.791964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2f37-ea63-4a15-8685-a871a65f4091 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:40.794744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce2f37-ea63-4a15-8685-a871a65f4091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:40.798999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce2f37-ea63-4a15-8685-a871a65f4091 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:40.857951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 834/1653] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:40 2022] POST /identity/v3/users => generated 284 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:40.861677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100364c-e639-4d6a-aca2-502a913be803 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:40.887150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100364c-e639-4d6a-aca2-502a913be803 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:40.906879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633abe35-9617-49ee-91c5-20e1202c7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:40.907686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abe35-9617-49ee-91c5-20e1202c7a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:40.907946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abe35-9617-49ee-91c5-20e1202c7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:40.908213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633abe35-9617-49ee-91c5-20e1202c7a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:40.908958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633abe35-9617-49ee-91c5-20e1202c7a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:40.910594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633abe35-9617-49ee-91c5-20e1202c7a4b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:40.934006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 820/1654] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:40.935038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2f37-ea63-4a15-8685-a871a65f4091 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:40.949656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2f37-ea63-4a15-8685-a871a65f4091 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:40.965455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd3e0-043f-43b2-8783-48d08af4982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:40.966369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd3e0-043f-43b2-8783-48d08af4982c admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:40.966642 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd3e0-043f-43b2-8783-48d08af4982c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:40.966911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd3e0-043f-43b2-8783-48d08af4982c admin admin] PATH_INFO: `/v3/projects/79e038d7f0a6473abf9c414476b3822c/users/e680da871628496ab9d1a15b02a48911/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:41.039765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bd3e0-043f-43b2-8783-48d08af4982c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e038d7f0a6473abf9c414476b3822c, user_id=e680da871628496ab9d1a15b02a48911, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:41.042472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bd3e0-043f-43b2-8783-48d08af4982c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:41.090662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 835/1655] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:40 2022] PUT /identity/v3/projects/79e038d7f0a6473abf9c414476b3822c/users/e680da871628496ab9d1a15b02a48911/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:41.094730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633abe35-9617-49ee-91c5-20e1202c7a4b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:41.109437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633abe35-9617-49ee-91c5-20e1202c7a4b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:41.260247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6a0c-a9e4-4d43-8a11-d06a85f24591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:41.262218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6a0c-a9e4-4d43-8a11-d06a85f24591 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:41.262998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6a0c-a9e4-4d43-8a11-d06a85f24591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:41.265478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6a0c-a9e4-4d43-8a11-d06a85f24591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:41.267087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6a0c-a9e4-4d43-8a11-d06a85f24591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:41.271217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6a0c-a9e4-4d43-8a11-d06a85f24591 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:41.294500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 821/1656] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:41.298769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd3e0-043f-43b2-8783-48d08af4982c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:41.326231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd3e0-043f-43b2-8783-48d08af4982c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:41.335845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:41.336938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:41.338956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:41.339688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] PATH_INFO: `/v3/projects/79e038d7f0a6473abf9c414476b3822c/users/e680da871628496ab9d1a15b02a48911/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:41.346149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e038d7f0a6473abf9c414476b3822c, user_id=e680da871628496ab9d1a15b02a48911, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:41.374382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:41.423250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 836/1657] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:41 2022] PUT /identity/v3/projects/79e038d7f0a6473abf9c414476b3822c/users/e680da871628496ab9d1a15b02a48911/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:41.433183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db44f0-6847-42c9-a2a8-cb7a7774ad0b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:41.433183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db44f0-6847-42c9-a2a8-cb7a7774ad0b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:41.433183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db44f0-6847-42c9-a2a8-cb7a7774ad0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:41.518732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-65db44f0-6847-42c9-a2a8-cb7a7774ad0b None None] MFA Rules not processed for user `e680da871628496ab9d1a15b02a48911`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:41.522305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-65db44f0-6847-42c9-a2a8-cb7a7774ad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:41.939786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 822/1658] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:41 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:41.956176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:41.958270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:42.225995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1004-9e76-4a59-8b49-ae40269aca04 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:42.245579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399d9fd-ab66-4773-bd94-e93732f77b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:42.250044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399d9fd-ab66-4773-bd94-e93732f77b12 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:42.251629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399d9fd-ab66-4773-bd94-e93732f77b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:42.252868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399d9fd-ab66-4773-bd94-e93732f77b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:42.292257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399d9fd-ab66-4773-bd94-e93732f77b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:42.293720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399d9fd-ab66-4773-bd94-e93732f77b12 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:42.329985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 837/1659] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:41 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:42.535241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db44f0-6847-42c9-a2a8-cb7a7774ad0b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:42.537545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-65db44f0-6847-42c9-a2a8-cb7a7774ad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:42.562833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8486-a046-4c76-b9ca-518ca9744f90 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:42.563746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8486-a046-4c76-b9ca-518ca9744f90 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:42.564164 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8486-a046-4c76-b9ca-518ca9744f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:42.568641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db44f0-6847-42c9-a2a8-cb7a7774ad0b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:42.574752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24323-6851-41e7-a1d7-6caabc9d93ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:42.575464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24323-6851-41e7-a1d7-6caabc9d93ac service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:42.575790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24323-6851-41e7-a1d7-6caabc9d93ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:42.576220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24323-6851-41e7-a1d7-6caabc9d93ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:42.602490 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-91ca8486-a046-4c76-b9ca-518ca9744f90 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:42.604113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-91ca8486-a046-4c76-b9ca-518ca9744f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:42.721577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c24323-6851-41e7-a1d7-6caabc9d93ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:42.723053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c24323-6851-41e7-a1d7-6caabc9d93ac service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:42.728603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 838/1660] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:57:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:42.745487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 823/1661] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:42 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:57:43.037826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca8486-a046-4c76-b9ca-518ca9744f90 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:43.040490 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-91ca8486-a046-4c76-b9ca-518ca9744f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:43.221468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca8486-a046-4c76-b9ca-518ca9744f90 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:43.245530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:43.246685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:43.247421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:43.248020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:43.322133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:43.325109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:43.337311 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 839/1662] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 18:57:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 18:57:44.180283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81ea-6e16-47ee-aa21-e66e2711c472 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:44.180823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81ea-6e16-47ee-aa21-e66e2711c472 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:44.180823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81ea-6e16-47ee-aa21-e66e2711c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:44.253408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-2abf81ea-6e16-47ee-aa21-e66e2711c472 None None] MFA Rules not processed for user `378aab35909343d88c0250493e41be34`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:44.257796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2abf81ea-6e16-47ee-aa21-e66e2711c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:44.492386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 824/1663] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:44.701172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:44.706883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:44.827822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f698-589e-4bef-993b-5fd3d98942b4 service swift] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:44.843679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e87e89-3cbd-43a1-a8e6-b36dbc7485d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:44.844819 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87e89-3cbd-43a1-a8e6-b36dbc7485d8 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:44.845222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87e89-3cbd-43a1-a8e6-b36dbc7485d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:44.846317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87e89-3cbd-43a1-a8e6-b36dbc7485d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:44.869432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e87e89-3cbd-43a1-a8e6-b36dbc7485d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:44.872142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e87e89-3cbd-43a1-a8e6-b36dbc7485d8 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:44.891851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 840/1664] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:45.130397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf81ea-6e16-47ee-aa21-e66e2711c472 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:45.131851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2abf81ea-6e16-47ee-aa21-e66e2711c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:45.290879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf81ea-6e16-47ee-aa21-e66e2711c472 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:45.315774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:45.319606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:45.320098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:45.320569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] PATH_INFO: `/v3/users/9e32dc69c3114cd7960308b1d7fd3c86` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:45.322200 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e32dc69c3114cd7960308b1d7fd3c86)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:45.335071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:45.468214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e32dc69c3114cd7960308b1d7fd3c86'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:45.505259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e32dc69c3114cd7960308b1d7fd3c86'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:45.507164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e32dc69c3114cd7960308b1d7fd3c86'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:45.529996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e32dc69c3114cd7960308b1d7fd3c86'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:45.530630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e32dc69c3114cd7960308b1d7fd3c86'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:45.578806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 825/1665] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:57:45 2022] DELETE /identity/v3/users/9e32dc69c3114cd7960308b1d7fd3c86 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:45.585100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e9eb-c80c-4344-afaa-01034e79ef8a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:45.585414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e9eb-c80c-4344-afaa-01034e79ef8a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:45.585694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e9eb-c80c-4344-afaa-01034e79ef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:45.663222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-34c8e9eb-c80c-4344-afaa-01034e79ef8a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:45.664534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-34c8e9eb-c80c-4344-afaa-01034e79ef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:45.799854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 841/1666] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:45.828548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:45.830014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:45.989071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8042f1b-cc39-42c1-ae76-9bf93168123d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:45.997606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:45.998511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:45.998941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:45.999462 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:46.037081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:46.038534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:46.064450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 826/1667] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:47.593721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4a8eb-c162-4597-a37b-085a3a68300a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:47.594365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4a8eb-c162-4597-a37b-085a3a68300a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:47.594365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4a8eb-c162-4597-a37b-085a3a68300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:47.656553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c1f4a8eb-c162-4597-a37b-085a3a68300a None None] MFA Rules not processed for user `af0204b62913420a90303c42dbded7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:47.669031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c1f4a8eb-c162-4597-a37b-085a3a68300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:47.688705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 842/1668] 10.222.0.96 () {58 vars in 1015 bytes} [Wed May 11 18:57:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:48.054601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:48.056206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:48.089565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95302-515a-44c0-8429-a266ee756d4f service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:48.109691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b327-70cd-4e49-8fb2-2595ebe00135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:48.110736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b327-70cd-4e49-8fb2-2595ebe00135 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:48.113810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b327-70cd-4e49-8fb2-2595ebe00135 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:48.114398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b327-70cd-4e49-8fb2-2595ebe00135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:48.158233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701b327-70cd-4e49-8fb2-2595ebe00135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:48.159884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701b327-70cd-4e49-8fb2-2595ebe00135 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:48.207826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 827/1669] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:48.327181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522d2a8-3d10-4b27-9cd6-358a44229d38 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:48.327771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522d2a8-3d10-4b27-9cd6-358a44229d38 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:48.328155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522d2a8-3d10-4b27-9cd6-358a44229d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:48.418758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3522d2a8-3d10-4b27-9cd6-358a44229d38 None None] MFA Rules not processed for user `c9d83909ea2943f5834778a2a9aa1485`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:48.420197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3522d2a8-3d10-4b27-9cd6-358a44229d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:48.597073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ca94-b0ba-4b11-b19b-1180486e8769 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:48.597433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ca94-b0ba-4b11-b19b-1180486e8769 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:48.597828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ca94-b0ba-4b11-b19b-1180486e8769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:48.599959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 843/1670] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:48.647371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-3619ca94-b0ba-4b11-b19b-1180486e8769 None None] MFA Rules not processed for user `c9d83909ea2943f5834778a2a9aa1485`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:48.650415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3619ca94-b0ba-4b11-b19b-1180486e8769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:48.680724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 828/1671] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:57:48.688006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522d2a8-3d10-4b27-9cd6-358a44229d38 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:48.689697 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3522d2a8-3d10-4b27-9cd6-358a44229d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:48.794729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619ca94-b0ba-4b11-b19b-1180486e8769 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:48.796462 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3619ca94-b0ba-4b11-b19b-1180486e8769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:48.833242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619ca94-b0ba-4b11-b19b-1180486e8769 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:48.859553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:48.861494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:48.861721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:48.861997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] PATH_INFO: `/v3/projects/5bc1e0447fab4adcafaf48de56af2eea` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:48.866707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc1e0447fab4adcafaf48de56af2eea)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:48.872736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:48.942292 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522d2a8-3d10-4b27-9cd6-358a44229d38 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:48.969354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d0dc8-0e88-4cdd-8049-39cfefb4a3b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:48.972515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d0dc8-0e88-4cdd-8049-39cfefb4a3b0 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:48.985985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d0dc8-0e88-4cdd-8049-39cfefb4a3b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:48.986705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d0dc8-0e88-4cdd-8049-39cfefb4a3b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:49.014521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d0dc8-0e88-4cdd-8049-39cfefb4a3b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:49.016597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d0dc8-0e88-4cdd-8049-39cfefb4a3b0 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:49.045532 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 844/1672] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:49.053333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc1e0447fab4adcafaf48de56af2eea', 'request_id': 'req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:49.075290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc1e0447fab4adcafaf48de56af2eea', 'request_id': 'req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:49.114893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc1e0447fab4adcafaf48de56af2eea', 'request_id': 'req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:49.225269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] The token cache is being invalidate because project 5bc1e0447fab4adcafaf48de56af2eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:57:49.225804 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:49.229506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9590bcd2-5b1e-48d4-9c2e-dbc870e1dc33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:49.242863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 829/1673] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:57:48 2022] DELETE /identity/v3/projects/5bc1e0447fab4adcafaf48de56af2eea => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:49.249459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9e03-b784-48d6-83cf-693147248470 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:49.249747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9e03-b784-48d6-83cf-693147248470 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:49.250029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9e03-b784-48d6-83cf-693147248470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:49.298200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-172e9e03-b784-48d6-83cf-693147248470 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:49.299957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-172e9e03-b784-48d6-83cf-693147248470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:49.447868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 845/1674] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:49.450036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93105ee0-7eb7-4ed8-82e5-4abd4e085831 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:49.450576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93105ee0-7eb7-4ed8-82e5-4abd4e085831 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:49.451070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93105ee0-7eb7-4ed8-82e5-4abd4e085831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:49.573350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-93105ee0-7eb7-4ed8-82e5-4abd4e085831 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:49.578451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-93105ee0-7eb7-4ed8-82e5-4abd4e085831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:49.665393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 830/1675] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:49.668238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e9e03-b784-48d6-83cf-693147248470 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:49.689618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e9e03-b784-48d6-83cf-693147248470 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:49.711660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:49.714989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:49.717379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:49.718612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:49.720779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:49.723353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:49.742419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:49.810321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 846/1676] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:57:49.813048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93105ee0-7eb7-4ed8-82e5-4abd4e085831 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:49.843078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93105ee0-7eb7-4ed8-82e5-4abd4e085831 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:49.884207 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:49.885090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:49.885449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:49.885804 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:49.887180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:49.890210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:49.969914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 831/1677] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:49 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:49.976127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:50.011513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15df223-59e4-404c-b34d-e72a15343684 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:50.082824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:50.085404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:50.319662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3316-aad3-42e2-b6c4-bf6aacbb84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:50.320412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3316-aad3-42e2-b6c4-bf6aacbb84e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:50.320765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3316-aad3-42e2-b6c4-bf6aacbb84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:50.321045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3316-aad3-42e2-b6c4-bf6aacbb84e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:50.321854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b3316-aad3-42e2-b6c4-bf6aacbb84e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:50.337838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b3316-aad3-42e2-b6c4-bf6aacbb84e2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:50.361277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c10391-bea8-45f8-9973-b182c36b5b80 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:50.386822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:50.387990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:50.388425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:50.388857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] PATH_INFO: `/v3/users/2f70bffe4dfe48d6a1efc2e471b05a3f` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:50.390395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f70bffe4dfe48d6a1efc2e471b05a3f)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:50.399492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:50.412677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 847/1678] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:49 2022] POST /identity/v3/users => generated 285 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:50.418587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3316-aad3-42e2-b6c4-bf6aacbb84e2 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:50.464213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3316-aad3-42e2-b6c4-bf6aacbb84e2 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:50.483708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c942bf6-9df9-4ded-a771-906a3ba536d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:50.491501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942bf6-9df9-4ded-a771-906a3ba536d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:50.494415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942bf6-9df9-4ded-a771-906a3ba536d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:50.494748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942bf6-9df9-4ded-a771-906a3ba536d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:50.498256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c942bf6-9df9-4ded-a771-906a3ba536d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:50.507469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c942bf6-9df9-4ded-a771-906a3ba536d3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:50.532240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f70bffe4dfe48d6a1efc2e471b05a3f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:50.556600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f70bffe4dfe48d6a1efc2e471b05a3f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:50.563724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f70bffe4dfe48d6a1efc2e471b05a3f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:50.571034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 848/1679] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:50.572775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c942bf6-9df9-4ded-a771-906a3ba536d3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:50.588310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f70bffe4dfe48d6a1efc2e471b05a3f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:50.590764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f691bdf5-fe9b-4561-b4e7-27e432ba5875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f70bffe4dfe48d6a1efc2e471b05a3f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:50.597838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c942bf6-9df9-4ded-a771-906a3ba536d3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:50.617317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:50.618038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:50.618289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:50.618741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:50.619713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:50.621324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:50.649163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 849/1680] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:57:50.650541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:50.656357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:50.660531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 832/1681] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:57:50 2022] DELETE /identity/v3/users/2f70bffe4dfe48d6a1efc2e471b05a3f => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:57:50.668862 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ea94-6087-4f9d-828b-88c6dc544bc8 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:50.669217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ea94-6087-4f9d-828b-88c6dc544bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:50.674485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ea94-6087-4f9d-828b-88c6dc544bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:50.689651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b9e0-1534-454a-9f38-f1ff7bbb0acd admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:50.739199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-60d5ea94-6087-4f9d-828b-88c6dc544bc8 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:50.745932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-60d5ea94-6087-4f9d-828b-88c6dc544bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:50.859185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:50.860122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:50.861723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:50.861723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] PATH_INFO: `/v3/projects/1993e0180a8d42d1bceab9d6e3776ff7/users/5e954895a7664d458f786a6a4eef61f5/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:50.919917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1993e0180a8d42d1bceab9d6e3776ff7, user_id=5e954895a7664d458f786a6a4eef61f5, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:50.922663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:50.951765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 833/1682] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:50.960254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 850/1683] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:50 2022] PUT /identity/v3/projects/1993e0180a8d42d1bceab9d6e3776ff7/users/5e954895a7664d458f786a6a4eef61f5/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:57:50.976619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7f0d-3111-4513-9e7e-f4dff1b2dd29 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:50.982702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7f0d-3111-4513-9e7e-f4dff1b2dd29 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:50.983451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7f0d-3111-4513-9e7e-f4dff1b2dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:51.032546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:51.036305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:51.097175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-467c7f0d-3111-4513-9e7e-f4dff1b2dd29 None None] MFA Rules not processed for user `5e954895a7664d458f786a6a4eef61f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:51.107419 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-467c7f0d-3111-4513-9e7e-f4dff1b2dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:51.266859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9dec4-7ad6-42b9-8275-7999eacef23a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:51.283800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba4036-aef4-4f3a-b407-a34a9b4d485a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:51.284476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba4036-aef4-4f3a-b407-a34a9b4d485a service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:51.284759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba4036-aef4-4f3a-b407-a34a9b4d485a service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:51.285057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba4036-aef4-4f3a-b407-a34a9b4d485a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:51.346411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 834/1684] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:51.357100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7f0d-3111-4513-9e7e-f4dff1b2dd29 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:51.485564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba4036-aef4-4f3a-b407-a34a9b4d485a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:51.487249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba4036-aef4-4f3a-b407-a34a9b4d485a service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:51.515435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 851/1685] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:57:51.548706 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7f0d-3111-4513-9e7e-f4dff1b2dd29 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:51.574178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de1640-4563-4989-90f5-09d1f3ce8e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:51.574917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1640-4563-4989-90f5-09d1f3ce8e9d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:51.575190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1640-4563-4989-90f5-09d1f3ce8e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:51.575514 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1640-4563-4989-90f5-09d1f3ce8e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:51.576175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de1640-4563-4989-90f5-09d1f3ce8e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:51.583081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de1640-4563-4989-90f5-09d1f3ce8e9d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:51.651064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 835/1686] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:51 2022] POST /identity/v3/projects => generated 367 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:51.655191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba4036-aef4-4f3a-b407-a34a9b4d485a service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:51.688990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba4036-aef4-4f3a-b407-a34a9b4d485a service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:51.860224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd1c60-49c0-4e1e-b778-9d6af65acffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:51.861569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1c60-49c0-4e1e-b778-9d6af65acffb admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:51.862085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1c60-49c0-4e1e-b778-9d6af65acffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:51.862542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1c60-49c0-4e1e-b778-9d6af65acffb admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:51.863939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd1c60-49c0-4e1e-b778-9d6af65acffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:51.867473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd1c60-49c0-4e1e-b778-9d6af65acffb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:51.904463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607daa6-ac19-42fe-87a8-9a990ee4c184 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:51.904900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607daa6-ac19-42fe-87a8-9a990ee4c184 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:51.905268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607daa6-ac19-42fe-87a8-9a990ee4c184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:51.907199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 852/1687] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:51 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:57:51.910124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd1c60-49c0-4e1e-b778-9d6af65acffb admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:51.969961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7607daa6-ac19-42fe-87a8-9a990ee4c184 None None] MFA Rules not processed for user `378aab35909343d88c0250493e41be34`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:51.971022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd1c60-49c0-4e1e-b778-9d6af65acffb admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:51.980396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7607daa6-ac19-42fe-87a8-9a990ee4c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:51.995252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bc4ba-624f-4519-94f7-aa1b83a0b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:52.002287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bc4ba-624f-4519-94f7-aa1b83a0b738 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:52.002762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bc4ba-624f-4519-94f7-aa1b83a0b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:52.004435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bc4ba-624f-4519-94f7-aa1b83a0b738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:52.009178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bc4ba-624f-4519-94f7-aa1b83a0b738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:52.010853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bc4ba-624f-4519-94f7-aa1b83a0b738 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:52.065657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 853/1688] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:52.070727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bc4ba-624f-4519-94f7-aa1b83a0b738 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:52.104666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bc4ba-624f-4519-94f7-aa1b83a0b738 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:52.149805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd90e7-4501-4d6a-9d66-d20715f28b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:52.152470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd90e7-4501-4d6a-9d66-d20715f28b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:52.157936 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd90e7-4501-4d6a-9d66-d20715f28b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:52.158300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd90e7-4501-4d6a-9d66-d20715f28b83 admin admin] PATH_INFO: `/v3/projects/27ef2a0f5faa48d29708b21ce3e3f793/users/90474c0c22dc4afb88d0e7121549497b/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:52.220312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd90e7-4501-4d6a-9d66-d20715f28b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ef2a0f5faa48d29708b21ce3e3f793, user_id=90474c0c22dc4afb88d0e7121549497b, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:52.224109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd90e7-4501-4d6a-9d66-d20715f28b83 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:52.225082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 836/1689] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:52.266479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 854/1690] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:52 2022] PUT /identity/v3/projects/27ef2a0f5faa48d29708b21ce3e3f793/users/90474c0c22dc4afb88d0e7121549497b/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:52.276156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607daa6-ac19-42fe-87a8-9a990ee4c184 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:52.307638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607daa6-ac19-42fe-87a8-9a990ee4c184 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:52.445474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071f13d-c618-42b3-9779-a3747dc18b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:52.447205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f13d-c618-42b3-9779-a3747dc18b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:52.449016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f13d-c618-42b3-9779-a3747dc18b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:52.449435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f13d-c618-42b3-9779-a3747dc18b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:52.450995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071f13d-c618-42b3-9779-a3747dc18b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:52.454215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071f13d-c618-42b3-9779-a3747dc18b7d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:52.490660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 837/1691] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:52.495605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd90e7-4501-4d6a-9d66-d20715f28b83 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:52.522754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd90e7-4501-4d6a-9d66-d20715f28b83 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:52.542199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000b1e6-95ec-4bcb-9043-e540aaeeef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:52.543647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b1e6-95ec-4bcb-9043-e540aaeeef2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:52.545755 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b1e6-95ec-4bcb-9043-e540aaeeef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:52.546212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000b1e6-95ec-4bcb-9043-e540aaeeef2f admin admin] PATH_INFO: `/v3/projects/27ef2a0f5faa48d29708b21ce3e3f793/users/90474c0c22dc4afb88d0e7121549497b/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:52.550566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000b1e6-95ec-4bcb-9043-e540aaeeef2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ef2a0f5faa48d29708b21ce3e3f793, user_id=90474c0c22dc4afb88d0e7121549497b, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:52.560369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000b1e6-95ec-4bcb-9043-e540aaeeef2f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:52.600443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747fb68-7aca-4689-9786-74ad935573a3 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:52.600443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747fb68-7aca-4689-9786-74ad935573a3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:52.600443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747fb68-7aca-4689-9786-74ad935573a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:52.624086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b747fb68-7aca-4689-9786-74ad935573a3 None None] MFA Rules not processed for user `c9d83909ea2943f5834778a2a9aa1485`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:52.625328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b747fb68-7aca-4689-9786-74ad935573a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:52.645342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 855/1692] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:52 2022] PUT /identity/v3/projects/27ef2a0f5faa48d29708b21ce3e3f793/users/90474c0c22dc4afb88d0e7121549497b/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:52.660234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e353-5183-4dfe-b514-4971eeb734cb None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:52.660519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e353-5183-4dfe-b514-4971eeb734cb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:52.660787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e353-5183-4dfe-b514-4971eeb734cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:52.749940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 838/1693] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:52.756104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a299e353-5183-4dfe-b514-4971eeb734cb None None] MFA Rules not processed for user `90474c0c22dc4afb88d0e7121549497b`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:52.759556 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a299e353-5183-4dfe-b514-4971eeb734cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:52.954100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747fb68-7aca-4689-9786-74ad935573a3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:52.955643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b747fb68-7aca-4689-9786-74ad935573a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:52.961709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 856/1694] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:53.133976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747fb68-7aca-4689-9786-74ad935573a3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:53.147572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099888-4caa-4472-ab02-1e01905269f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:53.151187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099888-4caa-4472-ab02-1e01905269f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:53.151844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099888-4caa-4472-ab02-1e01905269f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:53.152361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099888-4caa-4472-ab02-1e01905269f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:53.190636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11099888-4caa-4472-ab02-1e01905269f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:53.193010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11099888-4caa-4472-ab02-1e01905269f6 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:53.228201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 839/1695] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:57:53.409694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e353-5183-4dfe-b514-4971eeb734cb None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:53.411786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a299e353-5183-4dfe-b514-4971eeb734cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:53.446974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e353-5183-4dfe-b514-4971eeb734cb None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:53.460206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:53.461108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:53.463067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:53.463493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:53.489509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e832-81d0-451a-81f1-c615e7f0580f None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:53.489912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e832-81d0-451a-81f1-c615e7f0580f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:53.490297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e832-81d0-451a-81f1-c615e7f0580f None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:53.492353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 840/1696] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 18:57:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:57:53.611406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6f5c-78b5-4328-a28a-b1a9711eaf02 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:53.611674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6f5c-78b5-4328-a28a-b1a9711eaf02 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:53.612058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6f5c-78b5-4328-a28a-b1a9711eaf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:53.643358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:53.645153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:53.655567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9a3c6f5c-78b5-4328-a28a-b1a9711eaf02 None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:53.656823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9a3c6f5c-78b5-4328-a28a-b1a9711eaf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:53.684271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 857/1697] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:53.841402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 841/1698] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:54.092061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:54.094203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:54.251003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3527a29-ea23-4f12-9571-9311ceed27b8 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:54.265017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:54.266167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:54.266579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:54.267008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] PATH_INFO: `/v3/projects/78314e347f7c41cb9128630dd0d980bc` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:54.268416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78314e347f7c41cb9128630dd0d980bc)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:54.286902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:54.480357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78314e347f7c41cb9128630dd0d980bc', 'request_id': 'req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:54.499600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78314e347f7c41cb9128630dd0d980bc', 'request_id': 'req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:54.516849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78314e347f7c41cb9128630dd0d980bc', 'request_id': 'req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:54.551698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] The token cache is being invalidate because project 78314e347f7c41cb9128630dd0d980bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:57:54.554406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:54.556760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fc7a8185-e7b2-4fe8-bcc6-d4785f45632d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:54.567466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 858/1699] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:57:54 2022] DELETE /identity/v3/projects/78314e347f7c41cb9128630dd0d980bc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:54.570115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153373-876d-4761-9211-8f50418a7014 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:54.572113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153373-876d-4761-9211-8f50418a7014 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:54.572552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153373-876d-4761-9211-8f50418a7014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:54.621050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-0e153373-876d-4761-9211-8f50418a7014 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:54.624821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0e153373-876d-4761-9211-8f50418a7014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:54.772310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 842/1700] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:57:54.781910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823512-565d-4b57-8c73-bb88f926540d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:54.787546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823512-565d-4b57-8c73-bb88f926540d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:54.787546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823512-565d-4b57-8c73-bb88f926540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:54.807682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d5823512-565d-4b57-8c73-bb88f926540d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:54.809094 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d5823512-565d-4b57-8c73-bb88f926540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:54.828342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 859/1701] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:54.828459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153373-876d-4761-9211-8f50418a7014 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:54.858924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153373-876d-4761-9211-8f50418a7014 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:54.879253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:54.880424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:54.885469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:54.887485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:54.888989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:57:54.890552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:54.907854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:54.950877 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 843/1702] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:57:54.954951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823512-565d-4b57-8c73-bb88f926540d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:54.966367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823512-565d-4b57-8c73-bb88f926540d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:55.000024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de5885-30b8-414a-a0ff-e721e17e32fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:55.008334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de5885-30b8-414a-a0ff-e721e17e32fd admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:55.009482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de5885-30b8-414a-a0ff-e721e17e32fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:55.014777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de5885-30b8-414a-a0ff-e721e17e32fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:55.017860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de5885-30b8-414a-a0ff-e721e17e32fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:55.021558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de5885-30b8-414a-a0ff-e721e17e32fd admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:55.133866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 860/1703] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:54 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:55.134826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:55.154347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6544ae-8ee4-443f-98d9-edd6e734cdc2 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:55.443546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e812-bda1-44ec-bab6-e3c1f65aee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:55.446172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e812-bda1-44ec-bab6-e3c1f65aee5d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:55.448077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e812-bda1-44ec-bab6-e3c1f65aee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:55.450133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e812-bda1-44ec-bab6-e3c1f65aee5d admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:55.452433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e812-bda1-44ec-bab6-e3c1f65aee5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:55.458132 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e812-bda1-44ec-bab6-e3c1f65aee5d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:55.530211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 844/1704] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:55 2022] POST /identity/v3/users => generated 294 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:55.531581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de5885-30b8-414a-a0ff-e721e17e32fd admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:55.562249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de5885-30b8-414a-a0ff-e721e17e32fd admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:55.601556 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f23ac-e6f0-4647-ae8d-8d75838c8360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:55.601782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f23ac-e6f0-4647-ae8d-8d75838c8360 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:55.602097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f23ac-e6f0-4647-ae8d-8d75838c8360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:55.616009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f23ac-e6f0-4647-ae8d-8d75838c8360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:55.617543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f23ac-e6f0-4647-ae8d-8d75838c8360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:55.619154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f23ac-e6f0-4647-ae8d-8d75838c8360 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:55.694474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e812-bda1-44ec-bab6-e3c1f65aee5d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:55.696513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 861/1705] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:57:55.725242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e812-bda1-44ec-bab6-e3c1f65aee5d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:55.751246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6fc22-d6fb-4682-8d59-3302183fa9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:55.752366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6fc22-d6fb-4682-8d59-3302183fa9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:55.754084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6fc22-d6fb-4682-8d59-3302183fa9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:55.758554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6fc22-d6fb-4682-8d59-3302183fa9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:55.761115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6fc22-d6fb-4682-8d59-3302183fa9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:55.765930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6fc22-d6fb-4682-8d59-3302183fa9b9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:55.842726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 845/1706] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:57:55.847521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f23ac-e6f0-4647-ae8d-8d75838c8360 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:55.867357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f23ac-e6f0-4647-ae8d-8d75838c8360 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:55.877286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d410c7-f822-4867-b63c-8ab3d794f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:55.879109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d410c7-f822-4867-b63c-8ab3d794f889 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:55.879517 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d410c7-f822-4867-b63c-8ab3d794f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:55.879987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d410c7-f822-4867-b63c-8ab3d794f889 admin admin] PATH_INFO: `/v3/projects/975c6bfac0244751ab76333f922715cd/users/79a75c946aa74cbca7b43508984885bc/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:55.903452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d410c7-f822-4867-b63c-8ab3d794f889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=975c6bfac0244751ab76333f922715cd, user_id=79a75c946aa74cbca7b43508984885bc, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:55.912543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d410c7-f822-4867-b63c-8ab3d794f889 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:55.981726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 862/1707] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:55 2022] PUT /identity/v3/projects/975c6bfac0244751ab76333f922715cd/users/79a75c946aa74cbca7b43508984885bc/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:55.982768 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bfc07-f8a3-402d-9872-8f7a648e68e4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:55.983312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bfc07-f8a3-402d-9872-8f7a648e68e4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:55.983703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bfc07-f8a3-402d-9872-8f7a648e68e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:56.027446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc637-7b72-46c9-89e6-53298866148d None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:56.027664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc637-7b72-46c9-89e6-53298866148d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:56.027892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fc637-7b72-46c9-89e6-53298866148d None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:56.031899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 863/1708] 10.222.0.93 () {54 vars in 912 bytes} [Wed May 11 18:57:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:57:56.044256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011a1b8-8a61-4027-9712-35de16d7f414 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:56.044545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011a1b8-8a61-4027-9712-35de16d7f414 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:56.044818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011a1b8-8a61-4027-9712-35de16d7f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:56.074640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-554bfc07-f8a3-402d-9872-8f7a648e68e4 None None] MFA Rules not processed for user `79a75c946aa74cbca7b43508984885bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:56.076383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-554bfc07-f8a3-402d-9872-8f7a648e68e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:56.095853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b011a1b8-8a61-4027-9712-35de16d7f414 None None] MFA Rules not processed for user `af0204b62913420a90303c42dbded7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:56.098051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b011a1b8-8a61-4027-9712-35de16d7f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:56.369777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 846/1709] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:56.370232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bfc07-f8a3-402d-9872-8f7a648e68e4 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:56.429731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 864/1710] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:57:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:57:56.551918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bfc07-f8a3-402d-9872-8f7a648e68e4 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:56.576404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb0eb-c2e9-44d5-89a8-14cd3c47bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:56.579058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb0eb-c2e9-44d5-89a8-14cd3c47bb39 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:56.581623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb0eb-c2e9-44d5-89a8-14cd3c47bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:56.581919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb0eb-c2e9-44d5-89a8-14cd3c47bb39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:56.586948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceb0eb-c2e9-44d5-89a8-14cd3c47bb39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:56.590746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceb0eb-c2e9-44d5-89a8-14cd3c47bb39 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:56.718964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 847/1711] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:56 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:56.723141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011a1b8-8a61-4027-9712-35de16d7f414 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:56.767570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011a1b8-8a61-4027-9712-35de16d7f414 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:57.042517 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:57.043941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:57.046796 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:57.047846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:57.049501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:57.064801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:57.145934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 865/1712] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:56 2022] POST /identity/v3/users => generated 294 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:57:57.149734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb0eb-c2e9-44d5-89a8-14cd3c47bb39 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:57.175822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb0eb-c2e9-44d5-89a8-14cd3c47bb39 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:57.194485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf37893-5ccd-4808-8631-4df00354f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:57.197346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37893-5ccd-4808-8631-4df00354f55e admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:57.197905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37893-5ccd-4808-8631-4df00354f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:57.200008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37893-5ccd-4808-8631-4df00354f55e admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:57.200998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf37893-5ccd-4808-8631-4df00354f55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:57.205370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf37893-5ccd-4808-8631-4df00354f55e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:57.234708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:57.239394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:57.313589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 848/1713] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:57.322045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf37893-5ccd-4808-8631-4df00354f55e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:57.366031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf37893-5ccd-4808-8631-4df00354f55e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:57.414967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59446-a880-4a90-bf4b-95b60b7e0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:57.420965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59446-a880-4a90-bf4b-95b60b7e0c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:57.421648 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59446-a880-4a90-bf4b-95b60b7e0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:57.424529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59446-a880-4a90-bf4b-95b60b7e0c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:57.425502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe59446-a880-4a90-bf4b-95b60b7e0c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:57.439706 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe59446-a880-4a90-bf4b-95b60b7e0c51 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:57.494103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 849/1714] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:57.495049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59446-a880-4a90-bf4b-95b60b7e0c51 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:57.523109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc71ed-925c-4adc-b1e4-fb9ea94dc0c2 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:57.526257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59446-a880-4a90-bf4b-95b60b7e0c51 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:57.533178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf67731-ac5e-4d2c-86f7-bcc77fc96220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:57.535784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67731-ac5e-4d2c-86f7-bcc77fc96220 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:57.537233 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67731-ac5e-4d2c-86f7-bcc77fc96220 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:57.537991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67731-ac5e-4d2c-86f7-bcc77fc96220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:57.540296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:57.541720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:57.543575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:57.543986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] PATH_INFO: `/v3/projects/ead2d00f6aa445f7893596ada4174476/users/59c56065eb4146beaad7f0eee6d2202f/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:57.561332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf67731-ac5e-4d2c-86f7-bcc77fc96220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:57.568623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf67731-ac5e-4d2c-86f7-bcc77fc96220 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:57.586417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead2d00f6aa445f7893596ada4174476, user_id=59c56065eb4146beaad7f0eee6d2202f, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:57.589378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:57.590743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 866/1715] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:57:57.628420 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e13b-f48c-4756-9464-4501bfae178b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:57.628706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e13b-f48c-4756-9464-4501bfae178b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:57.629316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e13b-f48c-4756-9464-4501bfae178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:57.631480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 850/1716] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:57 2022] PUT /identity/v3/projects/ead2d00f6aa445f7893596ada4174476/users/59c56065eb4146beaad7f0eee6d2202f/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:57.654450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:57.656239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:57.787454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-1759e13b-f48c-4756-9464-4501bfae178b None None] MFA Rules not processed for user `59c56065eb4146beaad7f0eee6d2202f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:57.795066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1759e13b-f48c-4756-9464-4501bfae178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:58.017467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f394c0-30b2-430a-93e4-da5c24f3de2d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:58.037619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:58.038304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:58.038758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:58.039178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:58.041780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:58.067483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 867/1717] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:58.072712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759e13b-f48c-4756-9464-4501bfae178b None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:58.105887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:58.109302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:58.150811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 851/1718] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:57:58.280861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759e13b-f48c-4756-9464-4501bfae178b None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:58.302503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c78406-adfb-4fa7-945c-fabe4f0e749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:58.303195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78406-adfb-4fa7-945c-fabe4f0e749e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:58.303514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78406-adfb-4fa7-945c-fabe4f0e749e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:58.303788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78406-adfb-4fa7-945c-fabe4f0e749e admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:58.304491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c78406-adfb-4fa7-945c-fabe4f0e749e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:58.306440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c78406-adfb-4fa7-945c-fabe4f0e749e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:58.397222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:58.407093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 868/1719] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:57:58 2022] POST /identity/v3/projects => generated 387 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:57:58.408196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b090c-3410-4241-8b1e-38a9d4df66b5 service nova] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:58.634090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25032e-d786-4704-b8bf-174996c448a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:58.634955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25032e-d786-4704-b8bf-174996c448a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:58.635415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25032e-d786-4704-b8bf-174996c448a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:58.635841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25032e-d786-4704-b8bf-174996c448a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:58.636699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25032e-d786-4704-b8bf-174996c448a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:58.642251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25032e-d786-4704-b8bf-174996c448a4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:58.684781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 852/1720] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:57:58 2022] POST /identity/v3/users => generated 300 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:57:58.686721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c78406-adfb-4fa7-945c-fabe4f0e749e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:58.701684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c78406-adfb-4fa7-945c-fabe4f0e749e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:58.709522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c396a-0aca-483b-93a5-82c40e5efd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:58.710569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c396a-0aca-483b-93a5-82c40e5efd4b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:58.711075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c396a-0aca-483b-93a5-82c40e5efd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:58.712107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c396a-0aca-483b-93a5-82c40e5efd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:58.713065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c396a-0aca-483b-93a5-82c40e5efd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:58.715282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c396a-0aca-483b-93a5-82c40e5efd4b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:58.729737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 869/1721] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:57:58.733652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25032e-d786-4704-b8bf-174996c448a4 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:58.745836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25032e-d786-4704-b8bf-174996c448a4 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:58.751547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6840-a88b-4d8f-a9bd-6ede161bd526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:58.753172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6840-a88b-4d8f-a9bd-6ede161bd526 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:58.754001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6840-a88b-4d8f-a9bd-6ede161bd526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:58.754610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6840-a88b-4d8f-a9bd-6ede161bd526 admin admin] PATH_INFO: `/v3/projects/31338c9ab9bd4420a71a2892dc0b902b/users/32726472279a4680a58b72f27714244d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:58.775675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6840-a88b-4d8f-a9bd-6ede161bd526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31338c9ab9bd4420a71a2892dc0b902b, user_id=32726472279a4680a58b72f27714244d, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:58.779199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6840-a88b-4d8f-a9bd-6ede161bd526 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:58.808027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 853/1722] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:58 2022] PUT /identity/v3/projects/31338c9ab9bd4420a71a2892dc0b902b/users/32726472279a4680a58b72f27714244d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:57:58.812102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c396a-0aca-483b-93a5-82c40e5efd4b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:58.837380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c396a-0aca-483b-93a5-82c40e5efd4b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:59.016149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2161d-6cb5-4be6-9879-974ae40c4d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:59.016845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2161d-6cb5-4be6-9879-974ae40c4d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:59.017128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2161d-6cb5-4be6-9879-974ae40c4d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:59.020660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2161d-6cb5-4be6-9879-974ae40c4d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:59.020660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2161d-6cb5-4be6-9879-974ae40c4d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:59.032739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2161d-6cb5-4be6-9879-974ae40c4d65 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:59.086240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6840-a88b-4d8f-a9bd-6ede161bd526 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:59.097202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6840-a88b-4d8f-a9bd-6ede161bd526 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:59.111362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 870/1723] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:57:59.135825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:59.136747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:59.137025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:59.137837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] PATH_INFO: `/v3/projects/31338c9ab9bd4420a71a2892dc0b902b/users/32726472279a4680a58b72f27714244d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:59.141789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31338c9ab9bd4420a71a2892dc0b902b, user_id=32726472279a4680a58b72f27714244d, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:59.149253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:59.199537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 854/1724] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:57:59 2022] PUT /identity/v3/projects/31338c9ab9bd4420a71a2892dc0b902b/users/32726472279a4680a58b72f27714244d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:59.213352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712be3d5-cfd2-4ac8-80dd-b582487cb17d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:59.213633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712be3d5-cfd2-4ac8-80dd-b582487cb17d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:59.213915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712be3d5-cfd2-4ac8-80dd-b582487cb17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:59.256186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-712be3d5-cfd2-4ac8-80dd-b582487cb17d None None] MFA Rules not processed for user `32726472279a4680a58b72f27714244d`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:59.257492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-712be3d5-cfd2-4ac8-80dd-b582487cb17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:59.381026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:59.383147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:59.397859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 871/1725] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:59.417500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712be3d5-cfd2-4ac8-80dd-b582487cb17d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:59.419401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-712be3d5-cfd2-4ac8-80dd-b582487cb17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:59.533291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712be3d5-cfd2-4ac8-80dd-b582487cb17d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:59.538972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784bf3d-037e-45a0-a15b-59bfd9749f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:59.539811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784bf3d-037e-45a0-a15b-59bfd9749f76 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:59.540199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784bf3d-037e-45a0-a15b-59bfd9749f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:59.540864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784bf3d-037e-45a0-a15b-59bfd9749f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:59.566218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784bf3d-037e-45a0-a15b-59bfd9749f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:59.569692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784bf3d-037e-45a0-a15b-59bfd9749f76 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:59.587000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f67e2-23b0-410f-a27d-83fe110d4af1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:57:59.592792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 872/1726] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:57:59.601479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a46d7-b05c-4211-b24b-73f948964d1c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:59.602111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a46d7-b05c-4211-b24b-73f948964d1c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:59.602388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a46d7-b05c-4211-b24b-73f948964d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:59.606465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:57:59.607413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:59.607697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:59.607972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] PATH_INFO: `/v3/users/5e954895a7664d458f786a6a4eef61f5` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:59.616192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e954895a7664d458f786a6a4eef61f5)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:57:59.618183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:57:59.703867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-016a46d7-b05c-4211-b24b-73f948964d1c None None] MFA Rules not processed for user `f8edf1e5f81c4e81b346c82cb48a47f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:59.705122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-016a46d7-b05c-4211-b24b-73f948964d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:59.769922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e954895a7664d458f786a6a4eef61f5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:59.788721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e954895a7664d458f786a6a4eef61f5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:59.796078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e954895a7664d458f786a6a4eef61f5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:59.823099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e954895a7664d458f786a6a4eef61f5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:59.823748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-89fa9dd2-cabb-435b-af47-5f5d3606997f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e954895a7664d458f786a6a4eef61f5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:57:59.884472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 855/1727] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:57:59 2022] DELETE /identity/v3/users/5e954895a7664d458f786a6a4eef61f5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:57:59.886337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f78c-7100-46e7-933f-4810b4e82127 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:57:59.886637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f78c-7100-46e7-933f-4810b4e82127 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:57:59.886895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f78c-7100-46e7-933f-4810b4e82127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:57:59.941188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-5704f78c-7100-46e7-933f-4810b4e82127 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:57:59.942427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5704f78c-7100-46e7-933f-4810b4e82127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:57:59.948787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 873/1728] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:57:59.967476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a46d7-b05c-4211-b24b-73f948964d1c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:57:59.968827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-016a46d7-b05c-4211-b24b-73f948964d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:00.071908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 856/1729] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:00.115255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704f78c-7100-46e7-933f-4810b4e82127 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:00.118395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5704f78c-7100-46e7-933f-4810b4e82127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:00.173741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a46d7-b05c-4211-b24b-73f948964d1c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:00.367554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704f78c-7100-46e7-933f-4810b4e82127 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:00.396644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fab17-343d-4aea-8297-63d86d95d090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:00.397608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fab17-343d-4aea-8297-63d86d95d090 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:00.400032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fab17-343d-4aea-8297-63d86d95d090 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:00.400552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fab17-343d-4aea-8297-63d86d95d090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:00.454636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fab17-343d-4aea-8297-63d86d95d090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:00.457682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fab17-343d-4aea-8297-63d86d95d090 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:00.542385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 857/1730] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:00.550367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351e057-e379-40c8-9455-c4f6aeea0063 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:00.550984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351e057-e379-40c8-9455-c4f6aeea0063 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:00.554077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351e057-e379-40c8-9455-c4f6aeea0063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:00.558640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798adc85-dd79-4182-95c2-4ac53f2f9426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:00.559364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798adc85-dd79-4182-95c2-4ac53f2f9426 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:00.559665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798adc85-dd79-4182-95c2-4ac53f2f9426 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:00.559939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798adc85-dd79-4182-95c2-4ac53f2f9426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:00.680215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-0351e057-e379-40c8-9455-c4f6aeea0063 None None] MFA Rules not processed for user `f1f10686b4814794aadc34ec6194cc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:00.681744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0351e057-e379-40c8-9455-c4f6aeea0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:00.830432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798adc85-dd79-4182-95c2-4ac53f2f9426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:00.839451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798adc85-dd79-4182-95c2-4ac53f2f9426 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:00.861770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 858/1731] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:00.896416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 874/1732] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:57:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 929 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:01.454988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351e057-e379-40c8-9455-c4f6aeea0063 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:01.457467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0351e057-e379-40c8-9455-c4f6aeea0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:01.617551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351e057-e379-40c8-9455-c4f6aeea0063 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:01.626316 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:01.626522 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:01.626791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:01.627070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:01.630095 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:01.782638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:01.790621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:01.839808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 859/1733] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:01.841158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798adc85-dd79-4182-95c2-4ac53f2f9426 service nova] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:01.857921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798adc85-dd79-4182-95c2-4ac53f2f9426 service nova] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:01.878949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303d339-040e-4ee7-96e9-31cd37edce47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:01.880054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303d339-040e-4ee7-96e9-31cd37edce47 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:01.880602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303d339-040e-4ee7-96e9-31cd37edce47 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:01.881125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303d339-040e-4ee7-96e9-31cd37edce47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:01.894495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303d339-040e-4ee7-96e9-31cd37edce47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:01.897703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303d339-040e-4ee7-96e9-31cd37edce47 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:01.920955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 875/1734] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:04.351551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:04.353566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:04.392292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e099bf-cbd7-450a-84ca-b6b11a76767a service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:04.408690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:04.409581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:04.410054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:04.410472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] PATH_INFO: `/v3/projects/1993e0180a8d42d1bceab9d6e3776ff7` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:04.411996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1993e0180a8d42d1bceab9d6e3776ff7)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:04.417560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:04.497001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1993e0180a8d42d1bceab9d6e3776ff7', 'request_id': 'req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.504390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1993e0180a8d42d1bceab9d6e3776ff7', 'request_id': 'req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.517448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1993e0180a8d42d1bceab9d6e3776ff7', 'request_id': 'req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.538794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] The token cache is being invalidate because project 1993e0180a8d42d1bceab9d6e3776ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:04.539467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.542552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.555639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 860/1735] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:04 2022] DELETE /identity/v3/projects/1993e0180a8d42d1bceab9d6e3776ff7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:04.556899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303d339-040e-4ee7-96e9-31cd37edce47 service nova] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:04.571632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303d339-040e-4ee7-96e9-31cd37edce47 service nova] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:04.652792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:04.653761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:04.654042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:04.654484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] PATH_INFO: `/v3/users/90474c0c22dc4afb88d0e7121549497b` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:04.655915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=90474c0c22dc4afb88d0e7121549497b)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:04.658860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:04.764206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90474c0c22dc4afb88d0e7121549497b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.812579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90474c0c22dc4afb88d0e7121549497b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.850872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90474c0c22dc4afb88d0e7121549497b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.853604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90474c0c22dc4afb88d0e7121549497b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.882567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a8289eed-94d2-4a6c-b0e6-bca022382fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90474c0c22dc4afb88d0e7121549497b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:04.899946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 876/1736] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:04 2022] DELETE /identity/v3/users/90474c0c22dc4afb88d0e7121549497b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:04.947637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:04.949817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:04.975316 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da49645-6b1b-4aae-a8ed-85cd47d66d8e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:05.142666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:05.143967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:05.144402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:05.144771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] PATH_INFO: `/v3/users/a893791b346b431fb57a25c306663846` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:05.146688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a893791b346b431fb57a25c306663846)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:05.150845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:05.318305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a893791b346b431fb57a25c306663846'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:05.371558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee785a-47c6-44c6-86ba-28f23557a5bb None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:05.372129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee785a-47c6-44c6-86ba-28f23557a5bb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:05.372611 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee785a-47c6-44c6-86ba-28f23557a5bb None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:05.376553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 877/1737] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 18:58:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:58:05.394522 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a893791b346b431fb57a25c306663846'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:05.419592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a893791b346b431fb57a25c306663846'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:05.451359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a893791b346b431fb57a25c306663846'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:05.452826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-21b3ff34-0e56-49d3-afcb-ae23584fc567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a893791b346b431fb57a25c306663846'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:05.513253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 861/1738] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:04 2022] DELETE /identity/v3/users/a893791b346b431fb57a25c306663846 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:05.520014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501747d-1727-41b8-97be-40dfe456bd97 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:05.521872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501747d-1727-41b8-97be-40dfe456bd97 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:05.522706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501747d-1727-41b8-97be-40dfe456bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:05.570249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca1736-9431-4cff-b8f9-ea6d79b247c3 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:05.570747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca1736-9431-4cff-b8f9-ea6d79b247c3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:05.571129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca1736-9431-4cff-b8f9-ea6d79b247c3 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:05.572935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 862/1739] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 18:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 18:58:05.591409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef221817-45ef-4c71-8d54-a506086c697d None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:05.591938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef221817-45ef-4c71-8d54-a506086c697d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:05.592319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef221817-45ef-4c71-8d54-a506086c697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:05.644387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ef221817-45ef-4c71-8d54-a506086c697d None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:05.649074 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ef221817-45ef-4c71-8d54-a506086c697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:05.653475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3501747d-1727-41b8-97be-40dfe456bd97 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:05.655523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3501747d-1727-41b8-97be-40dfe456bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:05.810440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 878/1740] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:05.817136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 863/1741] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 11 18:58:05.839989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6293-727f-48f7-a45a-8109d2f4690a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:05.840352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6293-727f-48f7-a45a-8109d2f4690a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:05.840759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6293-727f-48f7-a45a-8109d2f4690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:05.882490 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c69f6293-727f-48f7-a45a-8109d2f4690a None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:05.886473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c69f6293-727f-48f7-a45a-8109d2f4690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:05.907345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 879/1742] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:06.226784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef221817-45ef-4c71-8d54-a506086c697d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:06.228815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ef221817-45ef-4c71-8d54-a506086c697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:06.353459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef221817-45ef-4c71-8d54-a506086c697d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:06.357673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3ade-cae2-4b04-a9db-e7767ca396c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:06.358530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3ade-cae2-4b04-a9db-e7767ca396c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:06.358990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3ade-cae2-4b04-a9db-e7767ca396c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:06.359437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3ade-cae2-4b04-a9db-e7767ca396c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:06.380893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3ade-cae2-4b04-a9db-e7767ca396c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:06.383103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3ade-cae2-4b04-a9db-e7767ca396c2 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:06.403145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 864/1743] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:06.419569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6293-727f-48f7-a45a-8109d2f4690a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:06.421343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c69f6293-727f-48f7-a45a-8109d2f4690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:06.449196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6293-727f-48f7-a45a-8109d2f4690a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:06.457249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:06.459058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:06.459501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:06.459869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] PATH_INFO: `/v3/projects/27ef2a0f5faa48d29708b21ce3e3f793` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:06.461738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ef2a0f5faa48d29708b21ce3e3f793)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:06.464616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:06.589347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ef2a0f5faa48d29708b21ce3e3f793', 'request_id': 'req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:06.615059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ef2a0f5faa48d29708b21ce3e3f793', 'request_id': 'req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:06.624471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ef2a0f5faa48d29708b21ce3e3f793', 'request_id': 'req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:06.652486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] The token cache is being invalidate because project 27ef2a0f5faa48d29708b21ce3e3f793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:06.653228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:06.654234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:06.657710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 880/1744] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:06 2022] DELETE /identity/v3/projects/27ef2a0f5faa48d29708b21ce3e3f793 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:06.669127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28693f-4736-4cb8-9fbf-1522884cb2d1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:06.669806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28693f-4736-4cb8-9fbf-1522884cb2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:06.672192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28693f-4736-4cb8-9fbf-1522884cb2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:06.732006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9a28693f-4736-4cb8-9fbf-1522884cb2d1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:06.733641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9a28693f-4736-4cb8-9fbf-1522884cb2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:06.764078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:06.765785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:06.919201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f002ad-7ce0-453e-af5a-8dd0d76acc2d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:06.929898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:06.930585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:06.930860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:06.936119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:06.940493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:06.992355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:06.994133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.026545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 881/1745] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:58:07.141856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:07.155582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec93a7f-cacc-4746-843b-170c50457399 service nova] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:07.164013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0a1cf-a2fd-4fcc-a671-e475d1d61709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:07.164956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a1cf-a2fd-4fcc-a671-e475d1d61709 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.165576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a1cf-a2fd-4fcc-a671-e475d1d61709 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.165997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a1cf-a2fd-4fcc-a671-e475d1d61709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.169854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-10a0a1cf-a2fd-4fcc-a671-e475d1d61709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:07.183828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0a1cf-a2fd-4fcc-a671-e475d1d61709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:07.186426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0a1cf-a2fd-4fcc-a671-e475d1d61709 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.219615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 882/1746] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:58:07.273480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 865/1747] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:07.283981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3b718-bbcc-4041-babf-655d4a67d1c0 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.284270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3b718-bbcc-4041-babf-655d4a67d1c0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.284544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3b718-bbcc-4041-babf-655d4a67d1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.340350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d7b3b718-bbcc-4041-babf-655d4a67d1c0 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:07.341752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d7b3b718-bbcc-4041-babf-655d4a67d1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:07.383543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 883/1748] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:07.386963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28693f-4736-4cb8-9fbf-1522884cb2d1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:07.405513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28693f-4736-4cb8-9fbf-1522884cb2d1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:07.423989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:07.424660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.424933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.425191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.430157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:07.434831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:07.441568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.490698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3b718-bbcc-4041-babf-655d4a67d1c0 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:07.492488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 866/1749] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:58:07.496467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d7b3b718-bbcc-4041-babf-655d4a67d1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:07.500999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:07.534009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60dce-288d-42e2-88eb-ae63718aeb71 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:07.550346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4b982-8617-4007-852e-f2c25321a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:07.551108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4b982-8617-4007-852e-f2c25321a0fb admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.551741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4b982-8617-4007-852e-f2c25321a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.563175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4b982-8617-4007-852e-f2c25321a0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.564365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4b982-8617-4007-852e-f2c25321a0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:07.566939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4b982-8617-4007-852e-f2c25321a0fb admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.597764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3b718-bbcc-4041-babf-655d4a67d1c0 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:07.613515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:07.614262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.615058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.615371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.617437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:07.620391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 867/1750] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:07 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:07.628136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4b982-8617-4007-852e-f2c25321a0fb admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:07.706788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4b982-8617-4007-852e-f2c25321a0fb admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:07.712153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9569-8c35-4d4c-94b1-9a5b2098a295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:07.712872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9569-8c35-4d4c-94b1-9a5b2098a295 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.713155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9569-8c35-4d4c-94b1-9a5b2098a295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.713428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9569-8c35-4d4c-94b1-9a5b2098a295 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.714915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:07.716468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.717737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9569-8c35-4d4c-94b1-9a5b2098a295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:07.723054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9569-8c35-4d4c-94b1-9a5b2098a295 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.753413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 884/1751] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:58:07.788000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:07.795155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 868/1752] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:07 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:07.806779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92b24-44d9-4879-91bf-b628fd6a620d service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:07.816281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78a96-d8cd-4944-aa71-53aee7f2e261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:07.819043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78a96-d8cd-4944-aa71-53aee7f2e261 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.819654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78a96-d8cd-4944-aa71-53aee7f2e261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.819929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78a96-d8cd-4944-aa71-53aee7f2e261 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.820682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff78a96-d8cd-4944-aa71-53aee7f2e261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:07.825983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff78a96-d8cd-4944-aa71-53aee7f2e261 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.855260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 885/1753] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:07.859366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9569-8c35-4d4c-94b1-9a5b2098a295 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:07.872311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9569-8c35-4d4c-94b1-9a5b2098a295 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:07.877134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cde771-6553-47db-bafd-21261d1c3db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:07.877802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cde771-6553-47db-bafd-21261d1c3db6 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.878083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cde771-6553-47db-bafd-21261d1c3db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.878417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cde771-6553-47db-bafd-21261d1c3db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.879151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cde771-6553-47db-bafd-21261d1c3db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:07.880807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cde771-6553-47db-bafd-21261d1c3db6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.896863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78a96-d8cd-4944-aa71-53aee7f2e261 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:07.903447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 869/1754] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:07.908105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78a96-d8cd-4944-aa71-53aee7f2e261 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:07.914558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768f343-03e7-4c3c-abf5-af7888b2a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:07.916544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768f343-03e7-4c3c-abf5-af7888b2a979 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.917162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768f343-03e7-4c3c-abf5-af7888b2a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.917348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768f343-03e7-4c3c-abf5-af7888b2a979 admin admin] PATH_INFO: `/v3/projects/b75fbaa7722e49e2b9d42f41d0adf01c/users/9fe265184ea04d1089c240cd39f174e7/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.937078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768f343-03e7-4c3c-abf5-af7888b2a979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75fbaa7722e49e2b9d42f41d0adf01c, user_id=9fe265184ea04d1089c240cd39f174e7, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:07.942137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768f343-03e7-4c3c-abf5-af7888b2a979 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:07.974284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7df5-5e26-4974-98d6-f63ade0b83fd None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:07.974573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7df5-5e26-4974-98d6-f63ade0b83fd None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:07.975035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7df5-5e26-4974-98d6-f63ade0b83fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:07.977288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 886/1755] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:07 2022] PUT /identity/v3/projects/b75fbaa7722e49e2b9d42f41d0adf01c/users/9fe265184ea04d1089c240cd39f174e7/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:08.015737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-8d0c7df5-5e26-4974-98d6-f63ade0b83fd None None] MFA Rules not processed for user `9fe265184ea04d1089c240cd39f174e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:08.018572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8d0c7df5-5e26-4974-98d6-f63ade0b83fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:08.131382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768f343-03e7-4c3c-abf5-af7888b2a979 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:08.145900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 870/1756] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:08.284645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768f343-03e7-4c3c-abf5-af7888b2a979 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:08.295583 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e381-11f6-4847-9dd3-634c5377ff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:08.298183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e381-11f6-4847-9dd3-634c5377ff96 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:08.308418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e381-11f6-4847-9dd3-634c5377ff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:08.309182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e381-11f6-4847-9dd3-634c5377ff96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:08.311346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50e381-11f6-4847-9dd3-634c5377ff96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:08.321173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50e381-11f6-4847-9dd3-634c5377ff96 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:08.391986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 887/1757] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:08 2022] POST /identity/v3/projects => generated 383 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:08.396485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c7df5-5e26-4974-98d6-f63ade0b83fd None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:08.411653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c7df5-5e26-4974-98d6-f63ade0b83fd None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:08.534228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e8f83-ded5-4cc1-b7d6-9bf83870658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:08.535516 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e8f83-ded5-4cc1-b7d6-9bf83870658a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:08.535792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e8f83-ded5-4cc1-b7d6-9bf83870658a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:08.536294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e8f83-ded5-4cc1-b7d6-9bf83870658a admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:08.551782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e8f83-ded5-4cc1-b7d6-9bf83870658a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:08.555899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e8f83-ded5-4cc1-b7d6-9bf83870658a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:08.607631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 871/1758] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:08 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:58:08.611866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e381-11f6-4847-9dd3-634c5377ff96 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:08.626204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e381-11f6-4847-9dd3-634c5377ff96 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:08.640915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:08.641966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:08.642283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:08.642572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:08.655116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:08.657668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:08.688356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 888/1759] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:08.690473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e8f83-ded5-4cc1-b7d6-9bf83870658a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:08.712092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e8f83-ded5-4cc1-b7d6-9bf83870658a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:08.725222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961190e-d52d-417c-bf69-6fbc57215087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:08.726156 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961190e-d52d-417c-bf69-6fbc57215087 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:08.726428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961190e-d52d-417c-bf69-6fbc57215087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:08.726702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961190e-d52d-417c-bf69-6fbc57215087 admin admin] PATH_INFO: `/v3/projects/bf2d8d9c3ea441c5887ba1528166afb0/users/f347c76a92e14c0f862584eaf616942c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:08.730942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:08.733166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:08.778602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8027a-5225-49e8-bf9e-329d2bface17 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:08.815064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:08.815977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:08.816256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:08.816536 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] PATH_INFO: `/v3/projects/5d9c0f0627c647e589ff4636c66a592d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:08.820173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9c0f0627c647e589ff4636c66a592d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:08.822137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:08.826055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961190e-d52d-417c-bf69-6fbc57215087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2d8d9c3ea441c5887ba1528166afb0, user_id=f347c76a92e14c0f862584eaf616942c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:08.832166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961190e-d52d-417c-bf69-6fbc57215087 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:08.869347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 872/1760] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:08 2022] PUT /identity/v3/projects/bf2d8d9c3ea441c5887ba1528166afb0/users/f347c76a92e14c0f862584eaf616942c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:08.873086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961190e-d52d-417c-bf69-6fbc57215087 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:08.967665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9c0f0627c647e589ff4636c66a592d', 'request_id': 'req-bb96ec9e-7801-4911-ac06-17e330487364'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:08.979820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9c0f0627c647e589ff4636c66a592d', 'request_id': 'req-bb96ec9e-7801-4911-ac06-17e330487364'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.006959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9c0f0627c647e589ff4636c66a592d', 'request_id': 'req-bb96ec9e-7801-4911-ac06-17e330487364'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.040557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] The token cache is being invalidate because project 5d9c0f0627c647e589ff4636c66a592d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:09.041076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.042812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.045354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 889/1761] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:08 2022] DELETE /identity/v3/projects/5d9c0f0627c647e589ff4636c66a592d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:09.048907 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:09.054745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:09.057349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961190e-d52d-417c-bf69-6fbc57215087 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:09.225930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96ec9e-7801-4911-ac06-17e330487364 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:09.232507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:09.233191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:09.233475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:09.233581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:09.233757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:09.234498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:09.234661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:09.234983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:09.235358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] PATH_INFO: `/v3/users/e680da871628496ab9d1a15b02a48911` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:09.236127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:09.236788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e680da871628496ab9d1a15b02a48911)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:09.239490 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:09.258106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 873/1762] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:09.272633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:09.274301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:09.298408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a1968-d1df-4c40-a492-78aabfa8f500 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:09.334685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e680da871628496ab9d1a15b02a48911'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.348807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689b264-c6da-41e8-8c46-02803f4f4db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:09.349533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e680da871628496ab9d1a15b02a48911'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.351530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b264-c6da-41e8-8c46-02803f4f4db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:09.352984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b264-c6da-41e8-8c46-02803f4f4db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:09.354093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b264-c6da-41e8-8c46-02803f4f4db2 admin admin] PATH_INFO: `/v3/projects/bf2d8d9c3ea441c5887ba1528166afb0/users/f347c76a92e14c0f862584eaf616942c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:09.363665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689b264-c6da-41e8-8c46-02803f4f4db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2d8d9c3ea441c5887ba1528166afb0, user_id=f347c76a92e14c0f862584eaf616942c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:09.369519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689b264-c6da-41e8-8c46-02803f4f4db2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:09.375104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e680da871628496ab9d1a15b02a48911'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.376576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e680da871628496ab9d1a15b02a48911'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.398815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 874/1763] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:09 2022] PUT /identity/v3/projects/bf2d8d9c3ea441c5887ba1528166afb0/users/f347c76a92e14c0f862584eaf616942c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:09.400746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e680da871628496ab9d1a15b02a48911'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:09.409441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc036ce-2b7a-4a30-8f0c-cb5baa48709b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:09.409942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc036ce-2b7a-4a30-8f0c-cb5baa48709b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:09.410217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc036ce-2b7a-4a30-8f0c-cb5baa48709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:09.422747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 890/1764] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:09 2022] DELETE /identity/v3/users/e680da871628496ab9d1a15b02a48911 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:09.492248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-bdc036ce-2b7a-4a30-8f0c-cb5baa48709b None None] MFA Rules not processed for user `f347c76a92e14c0f862584eaf616942c`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:09.494177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bdc036ce-2b7a-4a30-8f0c-cb5baa48709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:09.626376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 875/1765] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:09.641070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:09.642718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:09.782764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87add5-687c-4f1f-a581-10558ff85d78 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:09.789802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:09.790729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:09.791624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:09.791624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:09.816115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:09.818437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:09.842944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 891/1766] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:10.016710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc036ce-2b7a-4a30-8f0c-cb5baa48709b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:10.031794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc036ce-2b7a-4a30-8f0c-cb5baa48709b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:10.037622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42421cbd-ff46-4009-ad61-12a123d2f288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:10.038685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42421cbd-ff46-4009-ad61-12a123d2f288 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:10.041239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42421cbd-ff46-4009-ad61-12a123d2f288 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:10.041239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42421cbd-ff46-4009-ad61-12a123d2f288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:10.045241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-42421cbd-ff46-4009-ad61-12a123d2f288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:10.167697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42421cbd-ff46-4009-ad61-12a123d2f288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:10.176302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42421cbd-ff46-4009-ad61-12a123d2f288 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:10.192525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 876/1767] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:10.537473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:10.539470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:10.677991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa638c5d-f223-4623-9d7d-a4ff617a5885 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:10.700705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:10.702106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:10.702553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:10.703388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] PATH_INFO: `/v3/projects/79e038d7f0a6473abf9c414476b3822c` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:10.706079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e038d7f0a6473abf9c414476b3822c)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:10.709139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:10.804899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e038d7f0a6473abf9c414476b3822c', 'request_id': 'req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:10.817097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e038d7f0a6473abf9c414476b3822c', 'request_id': 'req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:10.827384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e038d7f0a6473abf9c414476b3822c', 'request_id': 'req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:10.841500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] The token cache is being invalidate because project 79e038d7f0a6473abf9c414476b3822c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:10.842033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:10.842999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-545f7a3e-83d4-43dc-aeca-7b2d7f90d0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:10.847408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 892/1768] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:10 2022] DELETE /identity/v3/projects/79e038d7f0a6473abf9c414476b3822c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:10.850342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93990-689d-453a-90d6-6381eb72a6bf None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:10.850855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93990-689d-453a-90d6-6381eb72a6bf None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:10.851150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93990-689d-453a-90d6-6381eb72a6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:10.893174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d5f93990-689d-453a-90d6-6381eb72a6bf None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:10.895692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d5f93990-689d-453a-90d6-6381eb72a6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:11.073003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 877/1769] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:11.074469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77edf-1835-4086-aa7d-998aa0610006 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.076360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77edf-1835-4086-aa7d-998aa0610006 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.078392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77edf-1835-4086-aa7d-998aa0610006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.128766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0dd77edf-1835-4086-aa7d-998aa0610006 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:11.134206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0dd77edf-1835-4086-aa7d-998aa0610006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:11.175286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 893/1770] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:11.180397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f93990-689d-453a-90d6-6381eb72a6bf None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.191727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f93990-689d-453a-90d6-6381eb72a6bf None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:11.205258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54318d1c-dd82-45a9-8db9-cd8bf5afe38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:11.205939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54318d1c-dd82-45a9-8db9-cd8bf5afe38f admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.206216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54318d1c-dd82-45a9-8db9-cd8bf5afe38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.206483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54318d1c-dd82-45a9-8db9-cd8bf5afe38f admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.207219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54318d1c-dd82-45a9-8db9-cd8bf5afe38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:11.207617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54318d1c-dd82-45a9-8db9-cd8bf5afe38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:11.214158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54318d1c-dd82-45a9-8db9-cd8bf5afe38f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:11.250159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77edf-1835-4086-aa7d-998aa0610006 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.259749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 878/1771] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:11.264166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77edf-1835-4086-aa7d-998aa0610006 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:11.274704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a8ef-8af4-4d85-b790-c7e31adb1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:11.277636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a8ef-8af4-4d85-b790-c7e31adb1b7c admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.278180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a8ef-8af4-4d85-b790-c7e31adb1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.278493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a8ef-8af4-4d85-b790-c7e31adb1b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.280435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192a8ef-8af4-4d85-b790-c7e31adb1b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:11.290291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192a8ef-8af4-4d85-b790-c7e31adb1b7c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:11.315819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191198aa-f1b2-4d1a-bc57-d8f8a3c5ceee None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.316660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191198aa-f1b2-4d1a-bc57-d8f8a3c5ceee None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.316948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191198aa-f1b2-4d1a-bc57-d8f8a3c5ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.343502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 894/1772] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:11 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:11.348345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a8ef-8af4-4d85-b790-c7e31adb1b7c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.379089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-191198aa-f1b2-4d1a-bc57-d8f8a3c5ceee None None] MFA Rules not processed for user `f8edf1e5f81c4e81b346c82cb48a47f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:11.384995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-191198aa-f1b2-4d1a-bc57-d8f8a3c5ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:11.447514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a8ef-8af4-4d85-b790-c7e31adb1b7c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:11.452486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5cc5-724b-4ba9-ae6e-4e4b3b37ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:11.453245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5cc5-724b-4ba9-ae6e-4e4b3b37ffa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.453587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5cc5-724b-4ba9-ae6e-4e4b3b37ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.453937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5cc5-724b-4ba9-ae6e-4e4b3b37ffa1 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.454750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e5cc5-724b-4ba9-ae6e-4e4b3b37ffa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:11.456805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e5cc5-724b-4ba9-ae6e-4e4b3b37ffa1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:11.475783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 879/1773] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:11.477060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a349-6676-440d-9193-98841cc03d80 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.477344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a349-6676-440d-9193-98841cc03d80 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.477618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a349-6676-440d-9193-98841cc03d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.495121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 895/1774] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:11 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:11.496448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5cc5-724b-4ba9-ae6e-4e4b3b37ffa1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.497942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c896a349-6676-440d-9193-98841cc03d80 None None] MFA Rules not processed for user `f1f10686b4814794aadc34ec6194cc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:11.498308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c896a349-6676-440d-9193-98841cc03d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:11.516797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5cc5-724b-4ba9-ae6e-4e4b3b37ffa1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:11.523427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:11.524436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.524866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.525211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.527039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:11.528313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:11.541973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 896/1775] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:11.541973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.543213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:11.563599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8aa86-85a4-4b28-9563-5ac383233b48 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:11.569785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:11.570660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.570934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.571202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] PATH_INFO: `/v3/users/79a75c946aa74cbca7b43508984885bc` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.572510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a75c946aa74cbca7b43508984885bc)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:11.572711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 880/1776] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:11.573741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a349-6676-440d-9193-98841cc03d80 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.575193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:11.590052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a349-6676-440d-9193-98841cc03d80 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:11.595776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676ff2-51d4-4c2a-85d1-12137a3ee70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:11.596461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676ff2-51d4-4c2a-85d1-12137a3ee70c admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.596742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676ff2-51d4-4c2a-85d1-12137a3ee70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.597015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676ff2-51d4-4c2a-85d1-12137a3ee70c admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.597755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68676ff2-51d4-4c2a-85d1-12137a3ee70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:11.599481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68676ff2-51d4-4c2a-85d1-12137a3ee70c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:11.615963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 881/1777] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:11.617101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676ff2-51d4-4c2a-85d1-12137a3ee70c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.637612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676ff2-51d4-4c2a-85d1-12137a3ee70c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:11.645573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0f5f2-ffc7-4bbc-9c29-7a50dc381054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:11.646497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f5f2-ffc7-4bbc-9c29-7a50dc381054 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.646795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f5f2-ffc7-4bbc-9c29-7a50dc381054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.647721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f5f2-ffc7-4bbc-9c29-7a50dc381054 admin admin] PATH_INFO: `/v3/projects/9135a72faf7c437281048b7fac045d3e/users/6e7340d94b62451b94a173e17935bd1a/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.673993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a75c946aa74cbca7b43508984885bc'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:11.674190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0f5f2-ffc7-4bbc-9c29-7a50dc381054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9135a72faf7c437281048b7fac045d3e, user_id=6e7340d94b62451b94a173e17935bd1a, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:11.677827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0f5f2-ffc7-4bbc-9c29-7a50dc381054 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:11.693079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a75c946aa74cbca7b43508984885bc'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:11.699775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 882/1778] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:11 2022] PUT /identity/v3/projects/9135a72faf7c437281048b7fac045d3e/users/6e7340d94b62451b94a173e17935bd1a/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:11.717159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adddbdf-f2c6-4c42-9053-7cd8b2165eae None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.717441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adddbdf-f2c6-4c42-9053-7cd8b2165eae None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.718388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adddbdf-f2c6-4c42-9053-7cd8b2165eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.718752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a75c946aa74cbca7b43508984885bc'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:11.721368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a75c946aa74cbca7b43508984885bc'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:11.746449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6e1941ab-6661-4bfc-b5de-28f4b8837e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a75c946aa74cbca7b43508984885bc'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:11.766141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 897/1779] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:11 2022] DELETE /identity/v3/users/79a75c946aa74cbca7b43508984885bc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:11.771941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d6c0-acf8-4adb-910b-d8b24a6919f5 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:11.772228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d6c0-acf8-4adb-910b-d8b24a6919f5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:11.772506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d6c0-acf8-4adb-910b-d8b24a6919f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:11.786909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4adddbdf-f2c6-4c42-9053-7cd8b2165eae None None] MFA Rules not processed for user `6e7340d94b62451b94a173e17935bd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:11.788750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4adddbdf-f2c6-4c42-9053-7cd8b2165eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:11.810623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9591d6c0-acf8-4adb-910b-d8b24a6919f5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:11.811969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9591d6c0-acf8-4adb-910b-d8b24a6919f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:11.975150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 898/1780] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:11.990009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 883/1781] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:11.992656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591d6c0-acf8-4adb-910b-d8b24a6919f5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.993427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adddbdf-f2c6-4c42-9053-7cd8b2165eae None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:11.994649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9591d6c0-acf8-4adb-910b-d8b24a6919f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:11.995904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4adddbdf-f2c6-4c42-9053-7cd8b2165eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:12.037205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adddbdf-f2c6-4c42-9053-7cd8b2165eae None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:12.043964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cda1c5-e24d-448e-b5a6-b814cd3cab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:12.046017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cda1c5-e24d-448e-b5a6-b814cd3cab66 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.046421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cda1c5-e24d-448e-b5a6-b814cd3cab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.046698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cda1c5-e24d-448e-b5a6-b814cd3cab66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.047455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cda1c5-e24d-448e-b5a6-b814cd3cab66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:12.050397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cda1c5-e24d-448e-b5a6-b814cd3cab66 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:12.084895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591d6c0-acf8-4adb-910b-d8b24a6919f5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:12.105414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bec68-b7ff-419a-a3b6-69b9ac384e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:12.107160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bec68-b7ff-419a-a3b6-69b9ac384e65 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.107685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bec68-b7ff-419a-a3b6-69b9ac384e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.108161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bec68-b7ff-419a-a3b6-69b9ac384e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.115903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 884/1782] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:11 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:12.119870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cda1c5-e24d-448e-b5a6-b814cd3cab66 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:12.132027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bec68-b7ff-419a-a3b6-69b9ac384e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:12.133986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bec68-b7ff-419a-a3b6-69b9ac384e65 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:12.146839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 899/1783] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:12.205586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cda1c5-e24d-448e-b5a6-b814cd3cab66 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:12.212238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcf458-d1fd-465f-b21e-62de37f6deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:12.212930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf458-d1fd-465f-b21e-62de37f6deaf admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.213273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf458-d1fd-465f-b21e-62de37f6deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.213553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcf458-d1fd-465f-b21e-62de37f6deaf admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.214300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcf458-d1fd-465f-b21e-62de37f6deaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:12.218369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcf458-d1fd-465f-b21e-62de37f6deaf admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:12.250298 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 885/1784] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:12 2022] POST /identity/v3/users => generated 300 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:58:12.254026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bec68-b7ff-419a-a3b6-69b9ac384e65 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:12.266774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bec68-b7ff-419a-a3b6-69b9ac384e65 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:12.271943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1adf6-39ea-440e-bf58-6dfa4657f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:12.272754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1adf6-39ea-440e-bf58-6dfa4657f94b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.273075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1adf6-39ea-440e-bf58-6dfa4657f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.273326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1adf6-39ea-440e-bf58-6dfa4657f94b admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.274056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1adf6-39ea-440e-bf58-6dfa4657f94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:12.275696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1adf6-39ea-440e-bf58-6dfa4657f94b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:12.289448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 900/1785] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:12.290707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcf458-d1fd-465f-b21e-62de37f6deaf admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:12.305120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcf458-d1fd-465f-b21e-62de37f6deaf admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:12.309992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cbc9a-50a8-440a-898d-b607b942c039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:12.311213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cbc9a-50a8-440a-898d-b607b942c039 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.311610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cbc9a-50a8-440a-898d-b607b942c039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.311978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cbc9a-50a8-440a-898d-b607b942c039 admin admin] PATH_INFO: `/v3/projects/e67f588844c844b7a03439e63cec2144/users/cee41d66b09441e987b01852fe6455e1/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.346481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cbc9a-50a8-440a-898d-b607b942c039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67f588844c844b7a03439e63cec2144, user_id=cee41d66b09441e987b01852fe6455e1, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:12.350598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cbc9a-50a8-440a-898d-b607b942c039 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:12.372153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 886/1786] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:12 2022] PUT /identity/v3/projects/e67f588844c844b7a03439e63cec2144/users/cee41d66b09441e987b01852fe6455e1/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:12.376298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1adf6-39ea-440e-bf58-6dfa4657f94b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:12.394940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1adf6-39ea-440e-bf58-6dfa4657f94b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:12.471358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce1d79-788b-4890-958f-c80b190a9a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:12.472046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1d79-788b-4890-958f-c80b190a9a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.472322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1d79-788b-4890-958f-c80b190a9a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.472598 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1d79-788b-4890-958f-c80b190a9a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.473325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce1d79-788b-4890-958f-c80b190a9a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:12.475042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce1d79-788b-4890-958f-c80b190a9a90 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:12.489803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 901/1787] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:12.495027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cbc9a-50a8-440a-898d-b607b942c039 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:12.520530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cbc9a-50a8-440a-898d-b607b942c039 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:12.531936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:12.533160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.534004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.534392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] PATH_INFO: `/v3/projects/e67f588844c844b7a03439e63cec2144/users/cee41d66b09441e987b01852fe6455e1/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.537753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67f588844c844b7a03439e63cec2144, user_id=cee41d66b09441e987b01852fe6455e1, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:12.542031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:12.575643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6398-a19f-44e8-bedb-26eb348c0e89 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.576100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6398-a19f-44e8-bedb-26eb348c0e89 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.576206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6398-a19f-44e8-bedb-26eb348c0e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.577693 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 887/1788] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:12 2022] PUT /identity/v3/projects/e67f588844c844b7a03439e63cec2144/users/cee41d66b09441e987b01852fe6455e1/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:12.626866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-51fd6398-a19f-44e8-bedb-26eb348c0e89 None None] MFA Rules not processed for user `cee41d66b09441e987b01852fe6455e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:12.629147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-51fd6398-a19f-44e8-bedb-26eb348c0e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:12.742940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 902/1789] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:12.759047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:12.765211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:12.860550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891bfff-7bf4-4895-a605-4fe36155393f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:12.867105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb23a2-70ed-47c5-beba-ce8cb1a718bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:12.868383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb23a2-70ed-47c5-beba-ce8cb1a718bd service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:12.868701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb23a2-70ed-47c5-beba-ce8cb1a718bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:12.869073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb23a2-70ed-47c5-beba-ce8cb1a718bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:12.889147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb23a2-70ed-47c5-beba-ce8cb1a718bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:12.897372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb23a2-70ed-47c5-beba-ce8cb1a718bd service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:12.921902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 888/1790] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:12.930073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd6398-a19f-44e8-bedb-26eb348c0e89 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:12.932498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-51fd6398-a19f-44e8-bedb-26eb348c0e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:13.056345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb23a2-70ed-47c5-beba-ce8cb1a718bd service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:13.107089 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd6398-a19f-44e8-bedb-26eb348c0e89 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:13.115892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:13.117305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:13.117728 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:13.118421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] PATH_INFO: `/v3/projects/975c6bfac0244751ab76333f922715cd` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:13.121220 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=975c6bfac0244751ab76333f922715cd)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:13.124647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:13.242222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb23a2-70ed-47c5-beba-ce8cb1a718bd service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:13.262190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975c6bfac0244751ab76333f922715cd', 'request_id': 'req-8072b301-c50b-44fc-936c-0da05d4cec1f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.286832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975c6bfac0244751ab76333f922715cd', 'request_id': 'req-8072b301-c50b-44fc-936c-0da05d4cec1f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.296984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975c6bfac0244751ab76333f922715cd', 'request_id': 'req-8072b301-c50b-44fc-936c-0da05d4cec1f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.334884 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] The token cache is being invalidate because project 975c6bfac0244751ab76333f922715cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:13.335102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.335916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.343168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 903/1791] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:12 2022] DELETE /identity/v3/projects/975c6bfac0244751ab76333f922715cd => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:13.344471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:13.351738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:13.451114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:13.455476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072b301-c50b-44fc-936c-0da05d4cec1f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:13.456331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:13.456810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:13.457125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] PATH_INFO: `/v3/users/6e7340d94b62451b94a173e17935bd1a` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:13.461865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:13.462727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7340d94b62451b94a173e17935bd1a)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:13.462972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:13.463436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:13.463998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] PATH_INFO: `/v3/users/9fe265184ea04d1089c240cd39f174e7` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:13.465946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe265184ea04d1089c240cd39f174e7)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:13.468309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:13.469131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:13.538703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe265184ea04d1089c240cd39f174e7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.547675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe265184ea04d1089c240cd39f174e7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.581829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7340d94b62451b94a173e17935bd1a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.587835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe265184ea04d1089c240cd39f174e7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.588920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe265184ea04d1089c240cd39f174e7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.596713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7340d94b62451b94a173e17935bd1a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.597858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7340d94b62451b94a173e17935bd1a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.610405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe265184ea04d1089c240cd39f174e7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.613450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7340d94b62451b94a173e17935bd1a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.615418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e81c2bae-f287-436d-8343-2ef91403b50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7340d94b62451b94a173e17935bd1a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.628330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 904/1792] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:13 2022] DELETE /identity/v3/users/9fe265184ea04d1089c240cd39f174e7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:13.629864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:13.637817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:13.642503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 889/1793] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:13 2022] DELETE /identity/v3/users/6e7340d94b62451b94a173e17935bd1a => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:13.644851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0a36-4b34-4aa9-a898-e55a81319a06 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:13.645567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0a36-4b34-4aa9-a898-e55a81319a06 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:13.646020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0a36-4b34-4aa9-a898-e55a81319a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:13.672241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b93d0a36-4b34-4aa9-a898-e55a81319a06 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:13.674473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b93d0a36-4b34-4aa9-a898-e55a81319a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:13.781037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 890/1794] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:13.783154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf082a-1014-4385-9875-3ad8ba566672 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:13.783672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf082a-1014-4385-9875-3ad8ba566672 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:13.784010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf082a-1014-4385-9875-3ad8ba566672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:13.808789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288bd99-9dc1-40f3-b791-7752f5fd2fa8 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:13.814382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-6baf082a-1014-4385-9875-3ad8ba566672 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:13.816487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6baf082a-1014-4385-9875-3ad8ba566672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:13.817438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:13.819430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:13.819430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:13.819430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] PATH_INFO: `/v3/users/59c56065eb4146beaad7f0eee6d2202f` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:13.827460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c56065eb4146beaad7f0eee6d2202f)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:13.829431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:13.840288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 891/1795] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:13.843831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf082a-1014-4385-9875-3ad8ba566672 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:13.847243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6baf082a-1014-4385-9875-3ad8ba566672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:13.936122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c56065eb4146beaad7f0eee6d2202f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.957542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c56065eb4146beaad7f0eee6d2202f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.978354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf082a-1014-4385-9875-3ad8ba566672 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:13.981322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c56065eb4146beaad7f0eee6d2202f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.982911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c56065eb4146beaad7f0eee6d2202f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:13.984281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:13.985057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:13.985473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:13.986058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:13.988366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:14.016028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:14.016862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c56065eb4146beaad7f0eee6d2202f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:14.017841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:14.031679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 892/1797] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:14.032040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 905/1797] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:13 2022] DELETE /identity/v3/users/59c56065eb4146beaad7f0eee6d2202f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:14.032560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:14.038197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:14.084091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf084bc-f7a5-4077-9d5a-6306cd05e315 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:14.266568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:14.269054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:14.270992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:14.272278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:14.290527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:14.449843 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:14.457641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:14.483305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 893/1798] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:14.939968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:14.941948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:14.963802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111e92-8930-48f4-82b6-e6957ec7451b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:14.974621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:14.976801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:14.976801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:14.977295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] PATH_INFO: `/v3/projects/ead2d00f6aa445f7893596ada4174476` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:14.985238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead2d00f6aa445f7893596ada4174476)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:14.989297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:15.012036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:15.013434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:15.031911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13235-1078-49f1-9432-6f8120cb6212 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:15.045792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:15.047271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:15.047271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:15.051992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] PATH_INFO: `/v3/projects/b75fbaa7722e49e2b9d42f41d0adf01c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:15.060275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead2d00f6aa445f7893596ada4174476', 'request_id': 'req-06108288-3a34-4b73-ba6a-76702b4108d6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.067920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75fbaa7722e49e2b9d42f41d0adf01c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:15.070205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:15.073611 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead2d00f6aa445f7893596ada4174476', 'request_id': 'req-06108288-3a34-4b73-ba6a-76702b4108d6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.103398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead2d00f6aa445f7893596ada4174476', 'request_id': 'req-06108288-3a34-4b73-ba6a-76702b4108d6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.128133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] The token cache is being invalidate because project ead2d00f6aa445f7893596ada4174476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:15.128707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.129440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.132664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 906/1799] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:14 2022] DELETE /identity/v3/projects/ead2d00f6aa445f7893596ada4174476 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:15.136677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:15.138361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:15.183366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75fbaa7722e49e2b9d42f41d0adf01c', 'request_id': 'req-83a6c591-8aed-4061-8787-45ce65d8919c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.208951 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75fbaa7722e49e2b9d42f41d0adf01c', 'request_id': 'req-83a6c591-8aed-4061-8787-45ce65d8919c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.220662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75fbaa7722e49e2b9d42f41d0adf01c', 'request_id': 'req-83a6c591-8aed-4061-8787-45ce65d8919c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.241485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] The token cache is being invalidate because project b75fbaa7722e49e2b9d42f41d0adf01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:15.241775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.242440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.245073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 894/1800] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:15 2022] DELETE /identity/v3/projects/b75fbaa7722e49e2b9d42f41d0adf01c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:15.246545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:15.247934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:15.264272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06108288-3a34-4b73-ba6a-76702b4108d6 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:15.357713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6c591-8aed-4061-8787-45ce65d8919c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:15.361327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:15.362410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:15.363821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:15.364892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] PATH_INFO: `/v3/users/32726472279a4680a58b72f27714244d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:15.366842 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:15.367768 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:15.368046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:15.368318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] PATH_INFO: `/v3/projects/9135a72faf7c437281048b7fac045d3e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:15.369703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9135a72faf7c437281048b7fac045d3e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:15.372293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:15.376615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32726472279a4680a58b72f27714244d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:15.384358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:15.449473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9135a72faf7c437281048b7fac045d3e', 'request_id': 'req-e97dede8-a85e-488e-9597-927299fe0270'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.472658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9135a72faf7c437281048b7fac045d3e', 'request_id': 'req-e97dede8-a85e-488e-9597-927299fe0270'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.493109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9135a72faf7c437281048b7fac045d3e', 'request_id': 'req-e97dede8-a85e-488e-9597-927299fe0270'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.514338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] The token cache is being invalidate because project 9135a72faf7c437281048b7fac045d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:15.514775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.514904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32726472279a4680a58b72f27714244d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.515710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.518273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 895/1801] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:15 2022] DELETE /identity/v3/projects/9135a72faf7c437281048b7fac045d3e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:15.520306 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:15.523443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:15.534298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32726472279a4680a58b72f27714244d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.546430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32726472279a4680a58b72f27714244d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.547360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32726472279a4680a58b72f27714244d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.573695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32726472279a4680a58b72f27714244d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.585778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 907/1802] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:15 2022] DELETE /identity/v3/users/32726472279a4680a58b72f27714244d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:15.588933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:15.590920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:15.608975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dede8-a85e-488e-9597-927299fe0270 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:15.686906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:15.690586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:15.690933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:15.691276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] PATH_INFO: `/v3/users/f347c76a92e14c0f862584eaf616942c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:15.693291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f347c76a92e14c0f862584eaf616942c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:15.700628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:15.718693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b81e61-857c-4f19-b06d-eaa277547d65 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:15.726028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:15.727143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:15.727461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:15.728159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] PATH_INFO: `/v3/users/cee41d66b09441e987b01852fe6455e1` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:15.729092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee41d66b09441e987b01852fe6455e1)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:15.731782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:15.795457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f347c76a92e14c0f862584eaf616942c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.803433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f347c76a92e14c0f862584eaf616942c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.805044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f347c76a92e14c0f862584eaf616942c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.813207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee41d66b09441e987b01852fe6455e1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.817766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f347c76a92e14c0f862584eaf616942c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.818884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f347c76a92e14c0f862584eaf616942c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.823694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee41d66b09441e987b01852fe6455e1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.836039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee41d66b09441e987b01852fe6455e1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.837512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee41d66b09441e987b01852fe6455e1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.854289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee41d66b09441e987b01852fe6455e1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:15.876850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 908/1803] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:15 2022] DELETE /identity/v3/users/cee41d66b09441e987b01852fe6455e1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:15.880290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 896/1804] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:15 2022] DELETE /identity/v3/users/f347c76a92e14c0f862584eaf616942c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:16.249482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:16.251018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:16.305905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:16.309376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:16.367123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ee7c4-3914-47c4-869c-36285054e1e6 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:16.461803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:16.462893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:16.463350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:16.463792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] PATH_INFO: `/v3/projects/31338c9ab9bd4420a71a2892dc0b902b` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:16.465326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31338c9ab9bd4420a71a2892dc0b902b)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:16.467597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:16.470284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811cff5-22d4-44d1-8f72-cf4718a250e5 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:16.487565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:16.488690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:16.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:16.489780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] PATH_INFO: `/v3/projects/bf2d8d9c3ea441c5887ba1528166afb0` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:16.493045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2d8d9c3ea441c5887ba1528166afb0)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:16.495330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:16.545925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31338c9ab9bd4420a71a2892dc0b902b', 'request_id': 'req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.555124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31338c9ab9bd4420a71a2892dc0b902b', 'request_id': 'req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.565818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31338c9ab9bd4420a71a2892dc0b902b', 'request_id': 'req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.600387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] The token cache is being invalidate because project 31338c9ab9bd4420a71a2892dc0b902b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:16.600387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.600972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-18a7e51e-829d-4ee1-99ec-8cb2a542cf83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.603516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 909/1805] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:16 2022] DELETE /identity/v3/projects/31338c9ab9bd4420a71a2892dc0b902b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:16.609650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2d8d9c3ea441c5887ba1528166afb0', 'request_id': 'req-06c367b1-3931-4476-8321-385134cda4bf'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.612110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5c307-4bb4-44e9-8825-01d63e709018 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:16.612510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5c307-4bb4-44e9-8825-01d63e709018 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:16.612894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5c307-4bb4-44e9-8825-01d63e709018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:16.618431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2d8d9c3ea441c5887ba1528166afb0', 'request_id': 'req-06c367b1-3931-4476-8321-385134cda4bf'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.631830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2d8d9c3ea441c5887ba1528166afb0', 'request_id': 'req-06c367b1-3931-4476-8321-385134cda4bf'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.652769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3ce5c307-4bb4-44e9-8825-01d63e709018 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:16.657600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3ce5c307-4bb4-44e9-8825-01d63e709018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:16.657754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] The token cache is being invalidate because project bf2d8d9c3ea441c5887ba1528166afb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:16.658043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.662612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.665349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 897/1806] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:16 2022] DELETE /identity/v3/projects/bf2d8d9c3ea441c5887ba1528166afb0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:16.665932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:16.668782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:16.785209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c367b1-3931-4476-8321-385134cda4bf admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:16.792732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 910/1807] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:16.794648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701527fa-db68-42d4-96f1-cd00d1d81e3e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:16.795047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701527fa-db68-42d4-96f1-cd00d1d81e3e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:16.795504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701527fa-db68-42d4-96f1-cd00d1d81e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:16.798337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:16.802619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:16.803314 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:16.803729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] PATH_INFO: `/v3/projects/e67f588844c844b7a03439e63cec2144` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:16.807511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e67f588844c844b7a03439e63cec2144)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:16.810399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:16.831785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-701527fa-db68-42d4-96f1-cd00d1d81e3e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:16.835076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-701527fa-db68-42d4-96f1-cd00d1d81e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:16.856668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 911/1808] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:16.859090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3891-c095-41bf-a836-1b2a37d42ca9 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:16.859400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3891-c095-41bf-a836-1b2a37d42ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:16.859674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d3891-c095-41bf-a836-1b2a37d42ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:16.931731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3c3d3891-c095-41bf-a836-1b2a37d42ca9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:16.933555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3c3d3891-c095-41bf-a836-1b2a37d42ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:16.953290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e67f588844c844b7a03439e63cec2144', 'request_id': 'req-14c9ff2a-c6e6-4941-b871-e54b7494c882'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.969940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e67f588844c844b7a03439e63cec2144', 'request_id': 'req-14c9ff2a-c6e6-4941-b871-e54b7494c882'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:16.987680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e67f588844c844b7a03439e63cec2144', 'request_id': 'req-14c9ff2a-c6e6-4941-b871-e54b7494c882'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:17.015436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] The token cache is being invalidate because project e67f588844c844b7a03439e63cec2144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:17.016303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:17.022669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-14c9ff2a-c6e6-4941-b871-e54b7494c882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:17.026652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 898/1809] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:16 2022] DELETE /identity/v3/projects/e67f588844c844b7a03439e63cec2144 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:17.029346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07db8fb-9748-4388-bd87-781494e2c9ef None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.030694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07db8fb-9748-4388-bd87-781494e2c9ef None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.031708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07db8fb-9748-4388-bd87-781494e2c9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.072557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 912/1810] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:17.076440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e075fb-abfe-4f6a-8111-815e4ad9ce03 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.076809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e075fb-abfe-4f6a-8111-815e4ad9ce03 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.077160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e075fb-abfe-4f6a-8111-815e4ad9ce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.077460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b07db8fb-9748-4388-bd87-781494e2c9ef None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:17.079636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b07db8fb-9748-4388-bd87-781494e2c9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:17.115712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 899/1811] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:17.116740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07db8fb-9748-4388-bd87-781494e2c9ef None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.125575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f0e075fb-abfe-4f6a-8111-815e4ad9ce03 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:17.128219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f0e075fb-abfe-4f6a-8111-815e4ad9ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:17.146827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 913/1812] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:17.146827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e075fb-abfe-4f6a-8111-815e4ad9ce03 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.147070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07db8fb-9748-4388-bd87-781494e2c9ef None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.155055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.155788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.156072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.156534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.157279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:17.157589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.159189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.164671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e075fb-abfe-4f6a-8111-815e4ad9ce03 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.169803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683cb87-19dd-4937-a956-8969758cc50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.169922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683cb87-19dd-4937-a956-8969758cc50e admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.170209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683cb87-19dd-4937-a956-8969758cc50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.170481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683cb87-19dd-4937-a956-8969758cc50e admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.171208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683cb87-19dd-4937-a956-8969758cc50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:17.171540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683cb87-19dd-4937-a956-8969758cc50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.173266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683cb87-19dd-4937-a956-8969758cc50e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.186850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 914/1813] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:17.189959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 900/1814] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:17.191482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff4c14-f7db-4fca-a863-f8538e282c9c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.191766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff4c14-f7db-4fca-a863-f8538e282c9c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.192068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff4c14-f7db-4fca-a863-f8538e282c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.193948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.217772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d93e-8f79-4101-bcc0-7ab1572e96a7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.224293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ae43-b686-44bf-a737-82ccfc681e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.225261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ae43-b686-44bf-a737-82ccfc681e24 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.225647 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ae43-b686-44bf-a737-82ccfc681e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.225925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ae43-b686-44bf-a737-82ccfc681e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.226683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8ae43-b686-44bf-a737-82ccfc681e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.228762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8ae43-b686-44bf-a737-82ccfc681e24 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.230172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-2cff4c14-f7db-4fca-a863-f8538e282c9c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:17.231648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2cff4c14-f7db-4fca-a863-f8538e282c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:17.243239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 915/1815] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:17.244593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff4c14-f7db-4fca-a863-f8538e282c9c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.263895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff4c14-f7db-4fca-a863-f8538e282c9c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.265437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 901/1816] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/projects => generated 399 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:17.266546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ae43-b686-44bf-a737-82ccfc681e24 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.353776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ae43-b686-44bf-a737-82ccfc681e24 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.360970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.362222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.362683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.363328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.364344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:17.364832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.366473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.381067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad0ec-3534-436d-be2e-c939f8ebf20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.382368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad0ec-3534-436d-be2e-c939f8ebf20b admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.382708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad0ec-3534-436d-be2e-c939f8ebf20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.383088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad0ec-3534-436d-be2e-c939f8ebf20b admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.383892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad0ec-3534-436d-be2e-c939f8ebf20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.388498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad0ec-3534-436d-be2e-c939f8ebf20b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.391577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 902/1817] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:17.393061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.406897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9606eee-30f8-4f57-9dc9-48cf3bb3ecfd admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.414044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4baa17-94bc-4cf0-abf3-72ad62b5646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.414733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4baa17-94bc-4cf0-abf3-72ad62b5646f admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.415033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4baa17-94bc-4cf0-abf3-72ad62b5646f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.415342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4baa17-94bc-4cf0-abf3-72ad62b5646f admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.416047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4baa17-94bc-4cf0-abf3-72ad62b5646f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.417979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4baa17-94bc-4cf0-abf3-72ad62b5646f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.430461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 916/1818] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:17.433566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad0ec-3534-436d-be2e-c939f8ebf20b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.448983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 903/1819] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/users => generated 300 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:17.450608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4baa17-94bc-4cf0-abf3-72ad62b5646f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.470671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4baa17-94bc-4cf0-abf3-72ad62b5646f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.555979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d216aa-c993-48b6-963e-2e2274c840cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.557168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d216aa-c993-48b6-963e-2e2274c840cb admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.557635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d216aa-c993-48b6-963e-2e2274c840cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.558050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d216aa-c993-48b6-963e-2e2274c840cb admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.558891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d216aa-c993-48b6-963e-2e2274c840cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.561146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d216aa-c993-48b6-963e-2e2274c840cb admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.565389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad0ec-3534-436d-be2e-c939f8ebf20b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.572944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0e59-a7dd-483c-a113-b3ff2e290c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.576248 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0e59-a7dd-483c-a113-b3ff2e290c55 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.577378 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0e59-a7dd-483c-a113-b3ff2e290c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.577672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0e59-a7dd-483c-a113-b3ff2e290c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.578838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0e59-a7dd-483c-a113-b3ff2e290c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.582119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0e59-a7dd-483c-a113-b3ff2e290c55 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.592008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 904/1820] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:17.593222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d216aa-c993-48b6-963e-2e2274c840cb admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.609829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d216aa-c993-48b6-963e-2e2274c840cb admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.617169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044584-5670-44ec-a738-e393e42c7810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.617850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044584-5670-44ec-a738-e393e42c7810 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.618146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044584-5670-44ec-a738-e393e42c7810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.618399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044584-5670-44ec-a738-e393e42c7810 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.619149 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9044584-5670-44ec-a738-e393e42c7810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.620765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9044584-5670-44ec-a738-e393e42c7810 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.631645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 917/1821] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:17.632528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0e59-a7dd-483c-a113-b3ff2e290c55 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.637571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 905/1822] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:17.638483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044584-5670-44ec-a738-e393e42c7810 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.671009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044584-5670-44ec-a738-e393e42c7810 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.763103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0e59-a7dd-483c-a113-b3ff2e290c55 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.773168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e5662-b19f-48eb-a4d4-42e37f53311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.774002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e5662-b19f-48eb-a4d4-42e37f53311a admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.774356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e5662-b19f-48eb-a4d4-42e37f53311a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.774702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e5662-b19f-48eb-a4d4-42e37f53311a admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.775709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e5662-b19f-48eb-a4d4-42e37f53311a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.778235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e5662-b19f-48eb-a4d4-42e37f53311a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.798056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 918/1823] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:17.799529 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e5662-b19f-48eb-a4d4-42e37f53311a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.812466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e5662-b19f-48eb-a4d4-42e37f53311a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.825185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3c9a-3021-42cf-b3f3-80663bdd8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.826105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3c9a-3021-42cf-b3f3-80663bdd8be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.826818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3c9a-3021-42cf-b3f3-80663bdd8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.827233 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f3c9a-3021-42cf-b3f3-80663bdd8be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.829427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3c9a-3021-42cf-b3f3-80663bdd8be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.831366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f3c9a-3021-42cf-b3f3-80663bdd8be3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.831872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33ca7-6918-4c2b-857a-bcb635fd556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.832565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33ca7-6918-4c2b-857a-bcb635fd556b admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.832844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33ca7-6918-4c2b-857a-bcb635fd556b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.833671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33ca7-6918-4c2b-857a-bcb635fd556b admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.834373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e33ca7-6918-4c2b-857a-bcb635fd556b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.836393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e33ca7-6918-4c2b-857a-bcb635fd556b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.851855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 919/1824] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:17.853311 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3c9a-3021-42cf-b3f3-80663bdd8be3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.872601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f3c9a-3021-42cf-b3f3-80663bdd8be3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.875350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 906/1825] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:17 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:17.875350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33ca7-6918-4c2b-857a-bcb635fd556b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.888562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f6d0-f59b-4036-b3e6-0a8cc6e0641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.889276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f6d0-f59b-4036-b3e6-0a8cc6e0641a admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.889558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f6d0-f59b-4036-b3e6-0a8cc6e0641a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.891376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f6d0-f59b-4036-b3e6-0a8cc6e0641a admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.893899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0f6d0-f59b-4036-b3e6-0a8cc6e0641a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.896298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0f6d0-f59b-4036-b3e6-0a8cc6e0641a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.899852 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33ca7-6918-4c2b-857a-bcb635fd556b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.911668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 920/1826] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:17.912524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f6d0-f59b-4036-b3e6-0a8cc6e0641a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.922464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f6d0-f59b-4036-b3e6-0a8cc6e0641a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:17.925594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b36317-cc13-4e7d-b919-327152dc5b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.928291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e49e39-ed7e-434b-89cf-a14983a88a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:17.928971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49e39-ed7e-434b-89cf-a14983a88a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.929289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49e39-ed7e-434b-89cf-a14983a88a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.929571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49e39-ed7e-434b-89cf-a14983a88a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.930289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b36317-cc13-4e7d-b919-327152dc5b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:17.930416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e49e39-ed7e-434b-89cf-a14983a88a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.930854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b36317-cc13-4e7d-b919-327152dc5b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:17.931371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b36317-cc13-4e7d-b919-327152dc5b15 admin admin] PATH_INFO: `/v3/projects/7cf3a5fe5edf4fa79226a3340695a814/users/9897da2ed16a481ba31b9acf6a1b2160/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:17.932969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e49e39-ed7e-434b-89cf-a14983a88a36 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.960194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b36317-cc13-4e7d-b919-327152dc5b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf3a5fe5edf4fa79226a3340695a814, user_id=9897da2ed16a481ba31b9acf6a1b2160, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:17.967005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b36317-cc13-4e7d-b919-327152dc5b15 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:17.976455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 921/1827] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:17.977489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e49e39-ed7e-434b-89cf-a14983a88a36 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:17.999980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 907/1828] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:17 2022] PUT /identity/v3/projects/7cf3a5fe5edf4fa79226a3340695a814/users/9897da2ed16a481ba31b9acf6a1b2160/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:18.003167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b36317-cc13-4e7d-b919-327152dc5b15 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:18.011492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e49e39-ed7e-434b-89cf-a14983a88a36 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.103022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b36317-cc13-4e7d-b919-327152dc5b15 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.109958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481805c-5cce-4a87-87af-ebea1e0328f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:18.110639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481805c-5cce-4a87-87af-ebea1e0328f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.110922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481805c-5cce-4a87-87af-ebea1e0328f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.111200 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481805c-5cce-4a87-87af-ebea1e0328f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.112775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481805c-5cce-4a87-87af-ebea1e0328f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:18.115190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481805c-5cce-4a87-87af-ebea1e0328f0 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:18.128760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 908/1829] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:18.134116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c16c2-658e-4476-9054-522a9c1697ca None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.134116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c16c2-658e-4476-9054-522a9c1697ca None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.134116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c16c2-658e-4476-9054-522a9c1697ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.148120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a37ec6-2c50-4899-a415-8aa1e09a7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:18.149316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a37ec6-2c50-4899-a415-8aa1e09a7d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.149784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a37ec6-2c50-4899-a415-8aa1e09a7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.150726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a37ec6-2c50-4899-a415-8aa1e09a7d53 admin admin] PATH_INFO: `/v3/projects/233fd108ccac4cfbbc8e87c0e14026f1/users/013df637efae488b93092191ea4eda5e/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.166175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-cc8c16c2-658e-4476-9054-522a9c1697ca None None] MFA Rules not processed for user `9897da2ed16a481ba31b9acf6a1b2160`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:18.167878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-cc8c16c2-658e-4476-9054-522a9c1697ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:18.174777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a37ec6-2c50-4899-a415-8aa1e09a7d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233fd108ccac4cfbbc8e87c0e14026f1, user_id=013df637efae488b93092191ea4eda5e, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:18.179066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a37ec6-2c50-4899-a415-8aa1e09a7d53 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:18.210073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 922/1830] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:17 2022] PUT /identity/v3/projects/233fd108ccac4cfbbc8e87c0e14026f1/users/013df637efae488b93092191ea4eda5e/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:18.210935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a37ec6-2c50-4899-a415-8aa1e09a7d53 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:18.324387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 909/1831] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:18.333618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be24aa-99af-45f0-bcf7-42fb02410cc1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.333934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be24aa-99af-45f0-bcf7-42fb02410cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.335198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be24aa-99af-45f0-bcf7-42fb02410cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.374534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a37ec6-2c50-4899-a415-8aa1e09a7d53 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.384928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b8216-a4cf-4886-ade9-efcad2b66e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:18.386493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b8216-a4cf-4886-ade9-efcad2b66e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.386493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b8216-a4cf-4886-ade9-efcad2b66e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.386686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b8216-a4cf-4886-ade9-efcad2b66e22 admin admin] PATH_INFO: `/v3/projects/b9b695803d7d460eb7afcf55c8aa193d/users/f2488af085a7464f98208d09bb88e871/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.410701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b8216-a4cf-4886-ade9-efcad2b66e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b695803d7d460eb7afcf55c8aa193d, user_id=f2488af085a7464f98208d09bb88e871, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:18.414504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b8216-a4cf-4886-ade9-efcad2b66e22 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:18.420049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c0be24aa-99af-45f0-bcf7-42fb02410cc1 None None] MFA Rules not processed for user `013df637efae488b93092191ea4eda5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:18.421317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c0be24aa-99af-45f0-bcf7-42fb02410cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:18.443988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 923/1832] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:18 2022] PUT /identity/v3/projects/b9b695803d7d460eb7afcf55c8aa193d/users/f2488af085a7464f98208d09bb88e871/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:18.445357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b8216-a4cf-4886-ade9-efcad2b66e22 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:18.543054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 910/1833] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:18.544588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73349cf4-9bba-483f-a62a-cb7e7bf0465d None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.544806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73349cf4-9bba-483f-a62a-cb7e7bf0465d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.545106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73349cf4-9bba-483f-a62a-cb7e7bf0465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.568797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b8216-a4cf-4886-ade9-efcad2b66e22 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.580794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc88cc-1e6e-45fc-a13f-a4b1f8ed333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:18.582205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc88cc-1e6e-45fc-a13f-a4b1f8ed333f admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.582621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc88cc-1e6e-45fc-a13f-a4b1f8ed333f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.583091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc88cc-1e6e-45fc-a13f-a4b1f8ed333f admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.583932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc88cc-1e6e-45fc-a13f-a4b1f8ed333f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:18.586092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc88cc-1e6e-45fc-a13f-a4b1f8ed333f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:18.593427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-73349cf4-9bba-483f-a62a-cb7e7bf0465d None None] MFA Rules not processed for user `f2488af085a7464f98208d09bb88e871`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:18.594683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-73349cf4-9bba-483f-a62a-cb7e7bf0465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:18.638375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 924/1834] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:18 2022] POST /identity/v3/projects => generated 399 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:18.640045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc88cc-1e6e-45fc-a13f-a4b1f8ed333f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:18.710628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 911/1835] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:18.711555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73349cf4-9bba-483f-a62a-cb7e7bf0465d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:18.727911 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc88cc-1e6e-45fc-a13f-a4b1f8ed333f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.728933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73349cf4-9bba-483f-a62a-cb7e7bf0465d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.734472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297742b-b12c-4048-8683-462476767cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:18.734655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26987ebe-200c-4151-9fc3-57037724f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:18.735144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26987ebe-200c-4151-9fc3-57037724f137 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.735449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297742b-b12c-4048-8683-462476767cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.735575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26987ebe-200c-4151-9fc3-57037724f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.735761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26987ebe-200c-4151-9fc3-57037724f137 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.735863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297742b-b12c-4048-8683-462476767cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.736212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297742b-b12c-4048-8683-462476767cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.736564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26987ebe-200c-4151-9fc3-57037724f137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:18.737143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297742b-b12c-4048-8683-462476767cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:18.738731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26987ebe-200c-4151-9fc3-57037724f137 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:18.751000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297742b-b12c-4048-8683-462476767cb7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:18.764970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 912/1836] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:18 2022] POST /identity/v3/users => generated 306 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:18.769432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26987ebe-200c-4151-9fc3-57037724f137 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:18.791762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26987ebe-200c-4151-9fc3-57037724f137 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.805847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6767-8fe6-4c99-9a62-50a76e2cf59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:18.806548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 925/1837] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:18 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:18.807578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297742b-b12c-4048-8683-462476767cb7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:18.808635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6767-8fe6-4c99-9a62-50a76e2cf59a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.809831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6767-8fe6-4c99-9a62-50a76e2cf59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.810988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6767-8fe6-4c99-9a62-50a76e2cf59a admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.812765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6767-8fe6-4c99-9a62-50a76e2cf59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:18.819586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6767-8fe6-4c99-9a62-50a76e2cf59a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:18.879971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 913/1838] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:18 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:18.879971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6767-8fe6-4c99-9a62-50a76e2cf59a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:18.917988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297742b-b12c-4048-8683-462476767cb7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.986484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6767-8fe6-4c99-9a62-50a76e2cf59a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:18.994583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74445c7-bbbc-47af-9491-225cbb58f91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:18.996216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74445c7-bbbc-47af-9491-225cbb58f91d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:18.996640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74445c7-bbbc-47af-9491-225cbb58f91d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:18.997083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74445c7-bbbc-47af-9491-225cbb58f91d admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:18.998212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74445c7-bbbc-47af-9491-225cbb58f91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.001249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74445c7-bbbc-47af-9491-225cbb58f91d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.069829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 914/1839] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:18 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:19.070984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74445c7-bbbc-47af-9491-225cbb58f91d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.085043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74445c7-bbbc-47af-9491-225cbb58f91d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.086848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89378321-03d5-45f0-8fc4-b01b5f50f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.093231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89378321-03d5-45f0-8fc4-b01b5f50f107 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.094011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13b71-338c-49b5-8151-9ff2543f44d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.094428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89378321-03d5-45f0-8fc4-b01b5f50f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.094880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13b71-338c-49b5-8151-9ff2543f44d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.095233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13b71-338c-49b5-8151-9ff2543f44d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.095612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13b71-338c-49b5-8151-9ff2543f44d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.096520 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e13b71-338c-49b5-8151-9ff2543f44d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.096956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89378321-03d5-45f0-8fc4-b01b5f50f107 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.099668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e13b71-338c-49b5-8151-9ff2543f44d3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.100195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89378321-03d5-45f0-8fc4-b01b5f50f107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.106562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89378321-03d5-45f0-8fc4-b01b5f50f107 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.128710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 926/1840] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:19.130655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89378321-03d5-45f0-8fc4-b01b5f50f107 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.139727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 915/1841] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:19 2022] POST /identity/v3/users => generated 300 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:19.140609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13b71-338c-49b5-8151-9ff2543f44d3 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.142377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89378321-03d5-45f0-8fc4-b01b5f50f107 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.148281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4cd5e-708b-4f85-902c-6112143ba809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.149338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cd5e-708b-4f85-902c-6112143ba809 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.149794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cd5e-708b-4f85-902c-6112143ba809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.150264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4cd5e-708b-4f85-902c-6112143ba809 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.151327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4cd5e-708b-4f85-902c-6112143ba809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.152574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13b71-338c-49b5-8151-9ff2543f44d3 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.153368 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4cd5e-708b-4f85-902c-6112143ba809 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.158620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095a57e-5481-4d9c-a08b-d021b20639aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.159844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a57e-5481-4d9c-a08b-d021b20639aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.160201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a57e-5481-4d9c-a08b-d021b20639aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.160547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a57e-5481-4d9c-a08b-d021b20639aa admin admin] PATH_INFO: `/v3/projects/4b98029627ad4fb49d5ac60e39ae2d80/users/63f0e6806a804348b757a3b4bf1fe13c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.167228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 927/1842] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:19.168530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4cd5e-708b-4f85-902c-6112143ba809 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.179195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4cd5e-708b-4f85-902c-6112143ba809 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.184548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095a57e-5481-4d9c-a08b-d021b20639aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b98029627ad4fb49d5ac60e39ae2d80, user_id=63f0e6806a804348b757a3b4bf1fe13c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.188083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095a57e-5481-4d9c-a08b-d021b20639aa admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.189506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffe5c3-d0d7-4429-97ce-48a75ac001d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.191550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe5c3-d0d7-4429-97ce-48a75ac001d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.192768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe5c3-d0d7-4429-97ce-48a75ac001d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.193250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffe5c3-d0d7-4429-97ce-48a75ac001d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.194519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffe5c3-d0d7-4429-97ce-48a75ac001d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.200761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffe5c3-d0d7-4429-97ce-48a75ac001d3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.209882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 928/1843] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:19.211082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffe5c3-d0d7-4429-97ce-48a75ac001d3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.218581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 916/1844] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:19 2022] PUT /identity/v3/projects/4b98029627ad4fb49d5ac60e39ae2d80/users/63f0e6806a804348b757a3b4bf1fe13c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:19.219700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095a57e-5481-4d9c-a08b-d021b20639aa admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.225272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffe5c3-d0d7-4429-97ce-48a75ac001d3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.317334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2ca25-eece-464a-b1db-30576e5f42f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.317777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2ca25-eece-464a-b1db-30576e5f42f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.318068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2ca25-eece-464a-b1db-30576e5f42f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.322829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2ca25-eece-464a-b1db-30576e5f42f1 admin admin] PATH_INFO: `/v3/projects/1114708b75cb4fcc9548da9a1772f124/users/be8ca5830a8c455098e771fc9d22951d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.329219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095a57e-5481-4d9c-a08b-d021b20639aa admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.341139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80032e-648d-4ce0-b083-2cb16ecc7f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.342068 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80032e-648d-4ce0-b083-2cb16ecc7f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.342330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80032e-648d-4ce0-b083-2cb16ecc7f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.344764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80032e-648d-4ce0-b083-2cb16ecc7f12 admin admin] PATH_INFO: `/v3/projects/af4a396296a647d4878da23e3a9a0faf/users/0d11e4a7fb4b410281f2add69d1d9f6d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.359609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2ca25-eece-464a-b1db-30576e5f42f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1114708b75cb4fcc9548da9a1772f124, user_id=be8ca5830a8c455098e771fc9d22951d, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.364871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2ca25-eece-464a-b1db-30576e5f42f1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.375630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80032e-648d-4ce0-b083-2cb16ecc7f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4a396296a647d4878da23e3a9a0faf, user_id=0d11e4a7fb4b410281f2add69d1d9f6d, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.378621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80032e-648d-4ce0-b083-2cb16ecc7f12 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.390388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 929/1845] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:19 2022] PUT /identity/v3/projects/1114708b75cb4fcc9548da9a1772f124/users/be8ca5830a8c455098e771fc9d22951d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:19.391495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2ca25-eece-464a-b1db-30576e5f42f1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.409680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 917/1846] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:19 2022] PUT /identity/v3/projects/af4a396296a647d4878da23e3a9a0faf/users/0d11e4a7fb4b410281f2add69d1d9f6d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:19.412886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80032e-648d-4ce0-b083-2cb16ecc7f12 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.483370 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2ca25-eece-464a-b1db-30576e5f42f1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.514931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80032e-648d-4ce0-b083-2cb16ecc7f12 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.542059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2b4e-01c7-4c37-a4c0-b6ac8753529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.542897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2b4e-01c7-4c37-a4c0-b6ac8753529c admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.543180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2b4e-01c7-4c37-a4c0-b6ac8753529c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.543472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2b4e-01c7-4c37-a4c0-b6ac8753529c admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.544209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2b4e-01c7-4c37-a4c0-b6ac8753529c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.545831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2b4e-01c7-4c37-a4c0-b6ac8753529c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.575489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 918/1847] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:19.575489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2b4e-01c7-4c37-a4c0-b6ac8753529c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.588744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f720-ee51-46a8-8365-7e23ced9b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.589430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f720-ee51-46a8-8365-7e23ced9b37b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.589711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f720-ee51-46a8-8365-7e23ced9b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.589984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f720-ee51-46a8-8365-7e23ced9b37b admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.590864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6f720-ee51-46a8-8365-7e23ced9b37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.593699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6f720-ee51-46a8-8365-7e23ced9b37b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.600510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2b4e-01c7-4c37-a4c0-b6ac8753529c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.608975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94934412-e798-4e89-a786-9d22cdfb9950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.609644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94934412-e798-4e89-a786-9d22cdfb9950 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.609925 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94934412-e798-4e89-a786-9d22cdfb9950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.610190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94934412-e798-4e89-a786-9d22cdfb9950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.610847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 930/1848] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:19.614276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94934412-e798-4e89-a786-9d22cdfb9950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.614276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94934412-e798-4e89-a786-9d22cdfb9950 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.615929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f720-ee51-46a8-8365-7e23ced9b37b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.628507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f720-ee51-46a8-8365-7e23ced9b37b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.635895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 919/1849] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:19.635895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94934412-e798-4e89-a786-9d22cdfb9950 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.637577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864b35-f2f5-4d87-9f1a-7bcef40195cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.638554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864b35-f2f5-4d87-9f1a-7bcef40195cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.638906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864b35-f2f5-4d87-9f1a-7bcef40195cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.639264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864b35-f2f5-4d87-9f1a-7bcef40195cb admin admin] PATH_INFO: `/v3/projects/1114708b75cb4fcc9548da9a1772f124/users/be8ca5830a8c455098e771fc9d22951d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.641485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864b35-f2f5-4d87-9f1a-7bcef40195cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1114708b75cb4fcc9548da9a1772f124, user_id=be8ca5830a8c455098e771fc9d22951d, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.644374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864b35-f2f5-4d87-9f1a-7bcef40195cb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.650291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94934412-e798-4e89-a786-9d22cdfb9950 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.672423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 931/1850] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:19 2022] PUT /identity/v3/projects/1114708b75cb4fcc9548da9a1772f124/users/be8ca5830a8c455098e771fc9d22951d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:19.674267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864b35-f2f5-4d87-9f1a-7bcef40195cb admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:19.678179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285713d-f92e-40ed-b54a-98b287d58716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.680923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285713d-f92e-40ed-b54a-98b287d58716 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.680923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285713d-f92e-40ed-b54a-98b287d58716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.681885 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285713d-f92e-40ed-b54a-98b287d58716 admin admin] PATH_INFO: `/v3/projects/4b98029627ad4fb49d5ac60e39ae2d80/users/63f0e6806a804348b757a3b4bf1fe13c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.691459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285713d-f92e-40ed-b54a-98b287d58716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b98029627ad4fb49d5ac60e39ae2d80, user_id=63f0e6806a804348b757a3b4bf1fe13c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.696620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285713d-f92e-40ed-b54a-98b287d58716 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.737466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 920/1851] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:19 2022] PUT /identity/v3/projects/4b98029627ad4fb49d5ac60e39ae2d80/users/63f0e6806a804348b757a3b4bf1fe13c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:19.740619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de2f62-7957-4e10-a9bd-5ee48054a74c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.740911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de2f62-7957-4e10-a9bd-5ee48054a74c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.741186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de2f62-7957-4e10-a9bd-5ee48054a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.809767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-73de2f62-7957-4e10-a9bd-5ee48054a74c None None] MFA Rules not processed for user `be8ca5830a8c455098e771fc9d22951d`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:19.811007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-73de2f62-7957-4e10-a9bd-5ee48054a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:19.828584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864b35-f2f5-4d87-9f1a-7bcef40195cb admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:19.964551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e7942-c454-431b-b6ce-6a6ef047cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:19.965835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7942-c454-431b-b6ce-6a6ef047cd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.966235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7942-c454-431b-b6ce-6a6ef047cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.966988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7942-c454-431b-b6ce-6a6ef047cd06 admin admin] PATH_INFO: `/v3/projects/af4a396296a647d4878da23e3a9a0faf/users/0d11e4a7fb4b410281f2add69d1d9f6d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.969017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e7942-c454-431b-b6ce-6a6ef047cd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4a396296a647d4878da23e3a9a0faf, user_id=0d11e4a7fb4b410281f2add69d1d9f6d, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:19.971804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e7942-c454-431b-b6ce-6a6ef047cd06 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:19.984441 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 932/1852] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:19 2022] PUT /identity/v3/projects/af4a396296a647d4878da23e3a9a0faf/users/0d11e4a7fb4b410281f2add69d1d9f6d/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:19.986426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6874dd-8523-4ce5-858a-7fb6b34c4278 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:19.986789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6874dd-8523-4ce5-858a-7fb6b34c4278 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:19.987141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6874dd-8523-4ce5-858a-7fb6b34c4278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:19.989498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 921/1853] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:20.000956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86508e19-abd6-45e0-8e17-983faa14ad25 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:20.015476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86508e19-abd6-45e0-8e17-983faa14ad25 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:20.015762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86508e19-abd6-45e0-8e17-983faa14ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:20.031024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0c6874dd-8523-4ce5-858a-7fb6b34c4278 None None] MFA Rules not processed for user `63f0e6806a804348b757a3b4bf1fe13c`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:20.032540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0c6874dd-8523-4ce5-858a-7fb6b34c4278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:20.077315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-86508e19-abd6-45e0-8e17-983faa14ad25 None None] MFA Rules not processed for user `0d11e4a7fb4b410281f2add69d1d9f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:20.078542 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-86508e19-abd6-45e0-8e17-983faa14ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:20.181781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 933/1854] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:20.183394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6874dd-8523-4ce5-858a-7fb6b34c4278 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:20.193307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0c6874dd-8523-4ce5-858a-7fb6b34c4278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:20.199751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 922/1855] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:20.199751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86508e19-abd6-45e0-8e17-983faa14ad25 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:20.202933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-86508e19-abd6-45e0-8e17-983faa14ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:20.316980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86508e19-abd6-45e0-8e17-983faa14ad25 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:20.325018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead0dcc-e80c-47cf-8091-8cbc767012d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:20.326161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0dcc-e80c-47cf-8091-8cbc767012d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:20.326558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6874dd-8523-4ce5-858a-7fb6b34c4278 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:20.326768 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0dcc-e80c-47cf-8091-8cbc767012d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:20.327167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0dcc-e80c-47cf-8091-8cbc767012d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:20.339422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5c6f-5f4c-4330-8867-f9f9b86e0a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:20.340200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5c6f-5f4c-4330-8867-f9f9b86e0a38 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:20.340549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5c6f-5f4c-4330-8867-f9f9b86e0a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:20.340944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5c6f-5f4c-4330-8867-f9f9b86e0a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:20.349482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead0dcc-e80c-47cf-8091-8cbc767012d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:20.353096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead0dcc-e80c-47cf-8091-8cbc767012d6 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:20.386376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 923/1856] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:20.454825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5c6f-5f4c-4330-8867-f9f9b86e0a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:20.455839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead0dcc-e80c-47cf-8091-8cbc767012d6 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:20.456949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5c6f-5f4c-4330-8867-f9f9b86e0a38 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:20.470358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead0dcc-e80c-47cf-8091-8cbc767012d6 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:20.472242 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 934/1857] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:20.477567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2847b-a3e6-49af-b3fb-00aa9a322364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:20.478248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2847b-a3e6-49af-b3fb-00aa9a322364 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:20.478528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2847b-a3e6-49af-b3fb-00aa9a322364 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:20.478803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2847b-a3e6-49af-b3fb-00aa9a322364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:20.499912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2847b-a3e6-49af-b3fb-00aa9a322364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:20.501586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2847b-a3e6-49af-b3fb-00aa9a322364 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:20.515536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 924/1858] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:20.622956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5c6f-5f4c-4330-8867-f9f9b86e0a38 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:20.633464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5c6f-5f4c-4330-8867-f9f9b86e0a38 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:20.638779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc15a6-1db4-4bea-ae1e-b6b522cb1f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:20.640067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc15a6-1db4-4bea-ae1e-b6b522cb1f62 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:20.640193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc15a6-1db4-4bea-ae1e-b6b522cb1f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:20.640426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc15a6-1db4-4bea-ae1e-b6b522cb1f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:20.687982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2847b-a3e6-49af-b3fb-00aa9a322364 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:20.709750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2847b-a3e6-49af-b3fb-00aa9a322364 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:20.718810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecb957-6b1e-4ab3-b0f4-8f4b995d7893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:20.720975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecb957-6b1e-4ab3-b0f4-8f4b995d7893 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:20.721631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecb957-6b1e-4ab3-b0f4-8f4b995d7893 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:20.722113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecb957-6b1e-4ab3-b0f4-8f4b995d7893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:20.785546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc15a6-1db4-4bea-ae1e-b6b522cb1f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:20.789973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc15a6-1db4-4bea-ae1e-b6b522cb1f62 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:20.804567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 935/1859] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:20.861153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecb957-6b1e-4ab3-b0f4-8f4b995d7893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:20.863934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecb957-6b1e-4ab3-b0f4-8f4b995d7893 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:20.901258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 925/1860] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:21.346418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc15a6-1db4-4bea-ae1e-b6b522cb1f62 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:21.432954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc15a6-1db4-4bea-ae1e-b6b522cb1f62 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:21.437917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:21.439054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:21.439375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:21.439653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] PATH_INFO: `/v3/users/f2488af085a7464f98208d09bb88e871` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:21.441546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2488af085a7464f98208d09bb88e871)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:21.443890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:21.497451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2488af085a7464f98208d09bb88e871'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:21.507912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2488af085a7464f98208d09bb88e871'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:21.517539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2488af085a7464f98208d09bb88e871'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:21.518101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2488af085a7464f98208d09bb88e871'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:21.531456 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2488af085a7464f98208d09bb88e871'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:21.537964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 936/1861] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:21 2022] DELETE /identity/v3/users/f2488af085a7464f98208d09bb88e871 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:21.542759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc585-4441-4b47-b4f5-4b6055fd0a89 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:21.543272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc585-4441-4b47-b4f5-4b6055fd0a89 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:21.543414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc585-4441-4b47-b4f5-4b6055fd0a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:21.561739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-89cdc585-4441-4b47-b4f5-4b6055fd0a89 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:21.562967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-89cdc585-4441-4b47-b4f5-4b6055fd0a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:21.672417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 926/1862] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:21.686629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:21.688150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:21.778349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f24c80-05bc-4d98-a86a-afec6ad55767 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:21.783952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b02b5-58f9-4464-a312-c65f3935c522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:21.784676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b02b5-58f9-4464-a312-c65f3935c522 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:21.784965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b02b5-58f9-4464-a312-c65f3935c522 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:21.785247 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b02b5-58f9-4464-a312-c65f3935c522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:21.797136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b02b5-58f9-4464-a312-c65f3935c522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:21.798575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b02b5-58f9-4464-a312-c65f3935c522 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:21.810286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 937/1863] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:22.084101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc585-4441-4b47-b4f5-4b6055fd0a89 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:22.085644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-89cdc585-4441-4b47-b4f5-4b6055fd0a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:22.097916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc585-4441-4b47-b4f5-4b6055fd0a89 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:22.103542 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:22.104439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:22.104722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:22.104995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] PATH_INFO: `/v3/projects/b9b695803d7d460eb7afcf55c8aa193d` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:22.106282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b695803d7d460eb7afcf55c8aa193d)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:22.108876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:22.156722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b695803d7d460eb7afcf55c8aa193d', 'request_id': 'req-69349578-035f-43cc-a888-c945ce98cda8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.163255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b695803d7d460eb7afcf55c8aa193d', 'request_id': 'req-69349578-035f-43cc-a888-c945ce98cda8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.171438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b695803d7d460eb7afcf55c8aa193d', 'request_id': 'req-69349578-035f-43cc-a888-c945ce98cda8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.183176 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] The token cache is being invalidate because project b9b695803d7d460eb7afcf55c8aa193d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:22.183510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.184224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.185770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 927/1864] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:22 2022] DELETE /identity/v3/projects/b9b695803d7d460eb7afcf55c8aa193d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:22.190002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b02b5-58f9-4464-a312-c65f3935c522 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:22.202684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b02b5-58f9-4464-a312-c65f3935c522 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:22.271229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:22.272263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:22.272696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:22.273117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] PATH_INFO: `/v3/users/0d11e4a7fb4b410281f2add69d1d9f6d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:22.274882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d11e4a7fb4b410281f2add69d1d9f6d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:22.276468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:22.326852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d11e4a7fb4b410281f2add69d1d9f6d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.335597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d11e4a7fb4b410281f2add69d1d9f6d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.350090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d11e4a7fb4b410281f2add69d1d9f6d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.351014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d11e4a7fb4b410281f2add69d1d9f6d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.365357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-21231dc8-40ab-4345-9943-ab0ba0f91874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d11e4a7fb4b410281f2add69d1d9f6d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.373606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 938/1865] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:22 2022] DELETE /identity/v3/users/0d11e4a7fb4b410281f2add69d1d9f6d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:22.727923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:22.730038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:22.780572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349578-035f-43cc-a888-c945ce98cda8 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:22.878293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:22.879682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:22.879969 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:22.880790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] PATH_INFO: `/v3/projects/af4a396296a647d4878da23e3a9a0faf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:22.882172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4a396296a647d4878da23e3a9a0faf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:22.884270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:22.958015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4a396296a647d4878da23e3a9a0faf', 'request_id': 'req-2d198726-e80d-4c8c-b036-e92f06f19524'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.963992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4a396296a647d4878da23e3a9a0faf', 'request_id': 'req-2d198726-e80d-4c8c-b036-e92f06f19524'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.973171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4a396296a647d4878da23e3a9a0faf', 'request_id': 'req-2d198726-e80d-4c8c-b036-e92f06f19524'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.991942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] The token cache is being invalidate because project af4a396296a647d4878da23e3a9a0faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:22.992488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.993333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2d198726-e80d-4c8c-b036-e92f06f19524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:22.995134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 928/1866] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:22 2022] DELETE /identity/v3/projects/af4a396296a647d4878da23e3a9a0faf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:23.000064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2410b-0d17-4077-bfed-5f56a7409690 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.000522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2410b-0d17-4077-bfed-5f56a7409690 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.000605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2410b-0d17-4077-bfed-5f56a7409690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.021903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-16c2410b-0d17-4077-bfed-5f56a7409690 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:23.023325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-16c2410b-0d17-4077-bfed-5f56a7409690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:23.091470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 939/1867] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:23.099548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c6ec-704d-4ae0-afbb-1217e5df18e6 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.099774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c6ec-704d-4ae0-afbb-1217e5df18e6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.100048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c6ec-704d-4ae0-afbb-1217e5df18e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.127278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-91e9c6ec-704d-4ae0-afbb-1217e5df18e6 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:23.128636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-91e9c6ec-704d-4ae0-afbb-1217e5df18e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:23.138264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 929/1868] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:23.142642 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2410b-0d17-4077-bfed-5f56a7409690 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:23.152622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2410b-0d17-4077-bfed-5f56a7409690 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:23.158356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:23.159046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.159357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.160148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.160372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:23.160715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:23.162362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:23.175352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 940/1869] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:23.180666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c6ec-704d-4ae0-afbb-1217e5df18e6 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:23.191523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c6ec-704d-4ae0-afbb-1217e5df18e6 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:23.200029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a4748-c3b2-4abf-8f79-413201047bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:23.200029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a4748-c3b2-4abf-8f79-413201047bae admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.200029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a4748-c3b2-4abf-8f79-413201047bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.200029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a4748-c3b2-4abf-8f79-413201047bae admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.200442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a4748-c3b2-4abf-8f79-413201047bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:23.202188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a4748-c3b2-4abf-8f79-413201047bae admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:23.258577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 930/1870] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:23 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:23.260617 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:23.271169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534df8-19c6-44a6-a8a2-ca6af59a38ff admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:23.336941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bba23-c55f-4210-925e-fae98f2e473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:23.337736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bba23-c55f-4210-925e-fae98f2e473c admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.338092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bba23-c55f-4210-925e-fae98f2e473c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.338436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bba23-c55f-4210-925e-fae98f2e473c admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.339226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bba23-c55f-4210-925e-fae98f2e473c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:23.341470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bba23-c55f-4210-925e-fae98f2e473c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:23.362865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 941/1871] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:23 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:23.367532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a4748-c3b2-4abf-8f79-413201047bae admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:23.379155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a4748-c3b2-4abf-8f79-413201047bae admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:23.383877 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473966df-8b80-44a2-ae57-edec713b4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:23.384537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473966df-8b80-44a2-ae57-edec713b4c7e admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.384820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473966df-8b80-44a2-ae57-edec713b4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.385096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473966df-8b80-44a2-ae57-edec713b4c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.385817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473966df-8b80-44a2-ae57-edec713b4c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:23.387432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473966df-8b80-44a2-ae57-edec713b4c7e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:23.398056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 931/1872] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:23.403768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bba23-c55f-4210-925e-fae98f2e473c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:23.414815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bba23-c55f-4210-925e-fae98f2e473c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:23.420361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dae76d-111d-4f5a-a90c-21594b603ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:23.421020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dae76d-111d-4f5a-a90c-21594b603ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.421300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dae76d-111d-4f5a-a90c-21594b603ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.421572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dae76d-111d-4f5a-a90c-21594b603ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.422293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dae76d-111d-4f5a-a90c-21594b603ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:23.423922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dae76d-111d-4f5a-a90c-21594b603ff4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:23.437890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 942/1873] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:23.439375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473966df-8b80-44a2-ae57-edec713b4c7e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:23.449695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473966df-8b80-44a2-ae57-edec713b4c7e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:23.455706 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:23.456592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.456871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.457141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] PATH_INFO: `/v3/projects/4455a5d1c95f405daff00c525ecdafb9/users/e98cb2729fe944558cc7054e232ece67/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.474646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4455a5d1c95f405daff00c525ecdafb9, user_id=e98cb2729fe944558cc7054e232ece67, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:23.478130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:23.503040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 932/1874] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:23 2022] PUT /identity/v3/projects/4455a5d1c95f405daff00c525ecdafb9/users/e98cb2729fe944558cc7054e232ece67/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:23.505573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0b58-6f3f-4dba-b76a-954adacf6461 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.505917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0b58-6f3f-4dba-b76a-954adacf6461 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.506625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0b58-6f3f-4dba-b76a-954adacf6461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.536740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7a5c0b58-6f3f-4dba-b76a-954adacf6461 None None] MFA Rules not processed for user `e98cb2729fe944558cc7054e232ece67`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:23.537959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7a5c0b58-6f3f-4dba-b76a-954adacf6461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:23.601403 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 943/1875] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:23.612443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:23.614709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:23.671046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4696fde-a6e4-4132-8543-a097161c4dfa admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:23.674634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c2b15-a507-4699-997b-66d678979263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:23.675280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2b15-a507-4699-997b-66d678979263 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.675589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2b15-a507-4699-997b-66d678979263 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.675863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2b15-a507-4699-997b-66d678979263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.683996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2b15-a507-4699-997b-66d678979263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:23.685404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2b15-a507-4699-997b-66d678979263 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:23.694636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 933/1876] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:23.713885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c0b58-6f3f-4dba-b76a-954adacf6461 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:23.778577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c0b58-6f3f-4dba-b76a-954adacf6461 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:23.783346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:23.784237 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.784519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.784794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] PATH_INFO: `/v3/users/e98cb2729fe944558cc7054e232ece67` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.787599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98cb2729fe944558cc7054e232ece67)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:23.788616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:23.840486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98cb2729fe944558cc7054e232ece67'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:23.848709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98cb2729fe944558cc7054e232ece67'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:23.857600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98cb2729fe944558cc7054e232ece67'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:23.858275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98cb2729fe944558cc7054e232ece67'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:23.881398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98cb2729fe944558cc7054e232ece67'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:23.890501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 944/1877] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:23 2022] DELETE /identity/v3/users/e98cb2729fe944558cc7054e232ece67 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:23.898358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371bc33-ce59-4ba3-8cf2-82df3c309f38 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:23.898358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371bc33-ce59-4ba3-8cf2-82df3c309f38 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:23.898358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371bc33-ce59-4ba3-8cf2-82df3c309f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:23.917123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-2371bc33-ce59-4ba3-8cf2-82df3c309f38 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:23.918357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2371bc33-ce59-4ba3-8cf2-82df3c309f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:24.006251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 934/1878] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:24.016355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:24.017923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:24.101049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb1c8-f6a7-4403-b573-57f4af643160 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:24.105960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ac14c-8572-4b97-845c-cca099905ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:24.108409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ac14c-8572-4b97-845c-cca099905ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.108838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ac14c-8572-4b97-845c-cca099905ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.109418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ac14c-8572-4b97-845c-cca099905ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.120301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ac14c-8572-4b97-845c-cca099905ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:24.121820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ac14c-8572-4b97-845c-cca099905ff2 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:24.132839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 945/1879] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:24.474574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371bc33-ce59-4ba3-8cf2-82df3c309f38 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:24.476109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2371bc33-ce59-4ba3-8cf2-82df3c309f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:24.489242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371bc33-ce59-4ba3-8cf2-82df3c309f38 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:24.494553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:24.495467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.495751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.496026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] PATH_INFO: `/v3/projects/4455a5d1c95f405daff00c525ecdafb9` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.497267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4455a5d1c95f405daff00c525ecdafb9)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:24.499178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:24.550646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4455a5d1c95f405daff00c525ecdafb9', 'request_id': 'req-24e8ff32-37b4-401f-bfe0-04a7f35d5552'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:24.557770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4455a5d1c95f405daff00c525ecdafb9', 'request_id': 'req-24e8ff32-37b4-401f-bfe0-04a7f35d5552'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:24.564908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4455a5d1c95f405daff00c525ecdafb9', 'request_id': 'req-24e8ff32-37b4-401f-bfe0-04a7f35d5552'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:24.577547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] The token cache is being invalidate because project 4455a5d1c95f405daff00c525ecdafb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:24.577837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:24.578486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-24e8ff32-37b4-401f-bfe0-04a7f35d5552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:24.580116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 935/1880] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:24 2022] DELETE /identity/v3/projects/4455a5d1c95f405daff00c525ecdafb9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:24.585039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa94cc-b5a0-4c33-8c0d-e3d1ea8ea5da None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.585400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa94cc-b5a0-4c33-8c0d-e3d1ea8ea5da None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.585705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa94cc-b5a0-4c33-8c0d-e3d1ea8ea5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.603339 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d1fa94cc-b5a0-4c33-8c0d-e3d1ea8ea5da None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:24.604719 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d1fa94cc-b5a0-4c33-8c0d-e3d1ea8ea5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:24.677816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 946/1881] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:24.686310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586f58-fd8e-41ae-819f-90331654d709 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.686601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586f58-fd8e-41ae-819f-90331654d709 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.686882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586f58-fd8e-41ae-819f-90331654d709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.708558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-bc586f58-fd8e-41ae-819f-90331654d709 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:24.709968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bc586f58-fd8e-41ae-819f-90331654d709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:24.727514 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 936/1882] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:24.728279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa94cc-b5a0-4c33-8c0d-e3d1ea8ea5da None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:24.739728 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa94cc-b5a0-4c33-8c0d-e3d1ea8ea5da None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:24.746123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:24.746856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.747143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.747545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.748240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:24.748548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:24.750268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:24.764988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 947/1883] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:58:24.770247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586f58-fd8e-41ae-819f-90331654d709 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:24.786529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586f58-fd8e-41ae-819f-90331654d709 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:24.794397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39024e-822e-45b9-b55a-1d9ed4173d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:24.795190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39024e-822e-45b9-b55a-1d9ed4173d68 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.795619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39024e-822e-45b9-b55a-1d9ed4173d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.795793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39024e-822e-45b9-b55a-1d9ed4173d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.796501 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39024e-822e-45b9-b55a-1d9ed4173d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:24.798417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39024e-822e-45b9-b55a-1d9ed4173d68 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:24.833108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 937/1884] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:24 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:24.838000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:24.850730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a3a12-808d-4fda-96a3-865d78529afb admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:24.914630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc1f35-b6a1-4e53-b5d2-e2377e4c5b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:24.915345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1f35-b6a1-4e53-b5d2-e2377e4c5b09 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.915620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1f35-b6a1-4e53-b5d2-e2377e4c5b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.915897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc1f35-b6a1-4e53-b5d2-e2377e4c5b09 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.916706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc1f35-b6a1-4e53-b5d2-e2377e4c5b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:24.918722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc1f35-b6a1-4e53-b5d2-e2377e4c5b09 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:24.943374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 948/1885] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:24 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:24.945107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39024e-822e-45b9-b55a-1d9ed4173d68 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:24.955089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39024e-822e-45b9-b55a-1d9ed4173d68 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:24.959728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e69b6-46b4-4951-aa32-2dc0c4f27c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:24.960383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e69b6-46b4-4951-aa32-2dc0c4f27c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.960658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e69b6-46b4-4951-aa32-2dc0c4f27c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.960926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e69b6-46b4-4951-aa32-2dc0c4f27c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.961648 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e69b6-46b4-4951-aa32-2dc0c4f27c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:24.963224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e69b6-46b4-4951-aa32-2dc0c4f27c54 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:24.973938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 938/1886] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:24.977968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc1f35-b6a1-4e53-b5d2-e2377e4c5b09 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:24.987821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc1f35-b6a1-4e53-b5d2-e2377e4c5b09 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:24.993123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019ca11-1176-4662-a193-fdbf844c3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:24.993782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019ca11-1176-4662-a193-fdbf844c3a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:24.994052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019ca11-1176-4662-a193-fdbf844c3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:24.994327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019ca11-1176-4662-a193-fdbf844c3a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:24.995049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019ca11-1176-4662-a193-fdbf844c3a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:24.996680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019ca11-1176-4662-a193-fdbf844c3a9c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:25.006322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 949/1887] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:25.010151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e69b6-46b4-4951-aa32-2dc0c4f27c54 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:25.019608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e69b6-46b4-4951-aa32-2dc0c4f27c54 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:25.024154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:25.025006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:25.025280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:25.025553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] PATH_INFO: `/v3/projects/f3a825353a7e49549e4694bc0ccbdd80/users/7d53cbbb443d45cdb99644bdf921c008/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:25.039889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a825353a7e49549e4694bc0ccbdd80, user_id=7d53cbbb443d45cdb99644bdf921c008, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:25.042520 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:25.055590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 939/1888] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:25 2022] PUT /identity/v3/projects/f3a825353a7e49549e4694bc0ccbdd80/users/7d53cbbb443d45cdb99644bdf921c008/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:25.065928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3b379-987f-420e-b158-87debe312184 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:25.066418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3b379-987f-420e-b158-87debe312184 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:25.066617 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3b379-987f-420e-b158-87debe312184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:25.102212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-2ed3b379-987f-420e-b158-87debe312184 None None] MFA Rules not processed for user `7d53cbbb443d45cdb99644bdf921c008`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:25.104040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2ed3b379-987f-420e-b158-87debe312184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:25.171618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 950/1889] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:25.182414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:25.184238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:25.241723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a02d-ac1e-4c20-b7a3-8516da352188 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:25.245382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeec85c-0d7d-4937-80d6-bbee74f8510d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:25.246024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeec85c-0d7d-4937-80d6-bbee74f8510d service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:25.246302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeec85c-0d7d-4937-80d6-bbee74f8510d service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:25.246570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeec85c-0d7d-4937-80d6-bbee74f8510d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:25.255894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeec85c-0d7d-4937-80d6-bbee74f8510d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:25.257329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeec85c-0d7d-4937-80d6-bbee74f8510d service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:25.267838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 940/1890] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:25.458809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3b379-987f-420e-b158-87debe312184 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:25.460425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2ed3b379-987f-420e-b158-87debe312184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:25.601896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3b379-987f-420e-b158-87debe312184 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:25.611695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:25.612679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:25.612964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:25.613237 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] PATH_INFO: `/v3/users/9897da2ed16a481ba31b9acf6a1b2160` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:25.616401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9897da2ed16a481ba31b9acf6a1b2160)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:25.621371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:25.688749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9897da2ed16a481ba31b9acf6a1b2160'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:25.696789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9897da2ed16a481ba31b9acf6a1b2160'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:25.703681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9897da2ed16a481ba31b9acf6a1b2160'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:25.704298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9897da2ed16a481ba31b9acf6a1b2160'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:25.716330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9897da2ed16a481ba31b9acf6a1b2160'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:25.722200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 951/1891] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:25 2022] DELETE /identity/v3/users/9897da2ed16a481ba31b9acf6a1b2160 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:25.726735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258675f-da13-4212-afbb-996fb2685f9f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:25.727023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258675f-da13-4212-afbb-996fb2685f9f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:25.727331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258675f-da13-4212-afbb-996fb2685f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:25.744480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a258675f-da13-4212-afbb-996fb2685f9f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:25.745675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a258675f-da13-4212-afbb-996fb2685f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:25.803753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 941/1892] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:25.813269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:25.814705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:25.871143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763c10c-a1b2-46e6-82f3-1452d77e5c92 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:25.874837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fa8b6-1926-40f5-9f64-f525cf27e39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:25.875718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa8b6-1926-40f5-9f64-f525cf27e39f service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:25.876031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa8b6-1926-40f5-9f64-f525cf27e39f service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:25.876309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa8b6-1926-40f5-9f64-f525cf27e39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:25.886912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fa8b6-1926-40f5-9f64-f525cf27e39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:25.888377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fa8b6-1926-40f5-9f64-f525cf27e39f service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:25.898515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 952/1893] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:26.092278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258675f-da13-4212-afbb-996fb2685f9f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:26.093835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a258675f-da13-4212-afbb-996fb2685f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:26.105493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258675f-da13-4212-afbb-996fb2685f9f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:26.111853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:26.113088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:26.114105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:26.114526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] PATH_INFO: `/v3/users/013df637efae488b93092191ea4eda5e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:26.115956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=013df637efae488b93092191ea4eda5e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:26.121372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:26.170389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013df637efae488b93092191ea4eda5e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.177891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013df637efae488b93092191ea4eda5e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.178499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013df637efae488b93092191ea4eda5e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.186941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013df637efae488b93092191ea4eda5e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.187714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013df637efae488b93092191ea4eda5e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.206958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 942/1894] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:26 2022] DELETE /identity/v3/users/013df637efae488b93092191ea4eda5e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:26.211400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c70425-1fca-42b8-a2ed-cdb2b3a11580 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:26.212716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c70425-1fca-42b8-a2ed-cdb2b3a11580 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:26.213019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c70425-1fca-42b8-a2ed-cdb2b3a11580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:26.230776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a4c70425-1fca-42b8-a2ed-cdb2b3a11580 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:26.232025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a4c70425-1fca-42b8-a2ed-cdb2b3a11580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:26.295817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:26.297590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:26.297831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 953/1895] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:26.307551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c70425-1fca-42b8-a2ed-cdb2b3a11580 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:26.309422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a4c70425-1fca-42b8-a2ed-cdb2b3a11580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:26.316069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d939c1-d221-400c-ad85-d7e4a96f78bc admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:26.323794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:26.324940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:26.325216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:26.325487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] PATH_INFO: `/v3/projects/7cf3a5fe5edf4fa79226a3340695a814` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:26.327162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf3a5fe5edf4fa79226a3340695a814)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:26.329327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:26.375019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c70425-1fca-42b8-a2ed-cdb2b3a11580 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:26.385488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf3a5fe5edf4fa79226a3340695a814', 'request_id': 'req-949d7850-16d2-4517-84e6-73adaf86073b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.394184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf3a5fe5edf4fa79226a3340695a814', 'request_id': 'req-949d7850-16d2-4517-84e6-73adaf86073b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.402466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf3a5fe5edf4fa79226a3340695a814', 'request_id': 'req-949d7850-16d2-4517-84e6-73adaf86073b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.417416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] The token cache is being invalidate because project 7cf3a5fe5edf4fa79226a3340695a814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:26.417933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.418781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.420878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 943/1896] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:26 2022] DELETE /identity/v3/projects/7cf3a5fe5edf4fa79226a3340695a814 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:26.424753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:26.426984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:26.430890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:26.431508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:26.431789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:26.432065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:26.433850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:26.495601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7850-16d2-4517-84e6-73adaf86073b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:26.500211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:26.501302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:26.501580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:26.501902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] PATH_INFO: `/v3/users/63f0e6806a804348b757a3b4bf1fe13c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:26.503572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f0e6806a804348b757a3b4bf1fe13c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:26.504087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:26.505810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:26.505991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:26.516007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 954/1897] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:58:26.558033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f0e6806a804348b757a3b4bf1fe13c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.565300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f0e6806a804348b757a3b4bf1fe13c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.566057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f0e6806a804348b757a3b4bf1fe13c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.573075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f0e6806a804348b757a3b4bf1fe13c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.573785 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f0e6806a804348b757a3b4bf1fe13c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:26.592744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 944/1898] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:26 2022] DELETE /identity/v3/users/63f0e6806a804348b757a3b4bf1fe13c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:27.078087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:27.080122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:27.100790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18601-0d27-4f6e-b411-0e95c7fc43cb service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:27.231978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:27.232565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:27.232969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:27.233435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:27.233589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:27.234036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] PATH_INFO: `/v3/projects/233fd108ccac4cfbbc8e87c0e14026f1` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:27.235418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=233fd108ccac4cfbbc8e87c0e14026f1)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:27.238333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:27.252384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5354d-4fc1-4355-9e76-eedfaf7941cd admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:27.265447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:27.267059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:27.269286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:27.269715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] PATH_INFO: `/v3/projects/4b98029627ad4fb49d5ac60e39ae2d80` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:27.273863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b98029627ad4fb49d5ac60e39ae2d80)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:27.279422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:27.316470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233fd108ccac4cfbbc8e87c0e14026f1', 'request_id': 'req-2d4d176b-e323-42e6-be68-69beec3bf3d1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.327350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233fd108ccac4cfbbc8e87c0e14026f1', 'request_id': 'req-2d4d176b-e323-42e6-be68-69beec3bf3d1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.337251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233fd108ccac4cfbbc8e87c0e14026f1', 'request_id': 'req-2d4d176b-e323-42e6-be68-69beec3bf3d1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.340586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b98029627ad4fb49d5ac60e39ae2d80', 'request_id': 'req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.348233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b98029627ad4fb49d5ac60e39ae2d80', 'request_id': 'req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.353249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] The token cache is being invalidate because project 233fd108ccac4cfbbc8e87c0e14026f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:27.353635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.354506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.356973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 955/1899] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:27 2022] DELETE /identity/v3/projects/233fd108ccac4cfbbc8e87c0e14026f1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:27.359245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b98029627ad4fb49d5ac60e39ae2d80', 'request_id': 'req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.361800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:27.364828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:27.376624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] The token cache is being invalidate because project 4b98029627ad4fb49d5ac60e39ae2d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:27.376991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.378580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e0a13e9c-dd6b-4824-8a2b-55c8b6d24ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.380997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 945/1900] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:27 2022] DELETE /identity/v3/projects/4b98029627ad4fb49d5ac60e39ae2d80 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:27.385752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5bc0c-3045-4906-bbd2-6fb6c961f6b5 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:27.386109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5bc0c-3045-4906-bbd2-6fb6c961f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:27.386388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5bc0c-3045-4906-bbd2-6fb6c961f6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:27.408211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-bbc5bc0c-3045-4906-bbd2-6fb6c961f6b5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:27.409425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bbc5bc0c-3045-4906-bbd2-6fb6c961f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:27.434501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d176b-e323-42e6-be68-69beec3bf3d1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:27.475798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 946/1901] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:27.484690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d489-6404-4f63-a5ba-ecd57fce4136 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:27.491989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d489-6404-4f63-a5ba-ecd57fce4136 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:27.492714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d489-6404-4f63-a5ba-ecd57fce4136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:27.508254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:27.509635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:27.509992 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:27.510322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] PATH_INFO: `/v3/users/be8ca5830a8c455098e771fc9d22951d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:27.511871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8ca5830a8c455098e771fc9d22951d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:27.514252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:27.546966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-bc14d489-6404-4f63-a5ba-ecd57fce4136 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:27.553461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bc14d489-6404-4f63-a5ba-ecd57fce4136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:27.577208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 947/1902] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:27.595701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8ca5830a8c455098e771fc9d22951d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.598449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14d489-6404-4f63-a5ba-ecd57fce4136 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:27.616595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8ca5830a8c455098e771fc9d22951d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.640145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14d489-6404-4f63-a5ba-ecd57fce4136 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:27.643332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8ca5830a8c455098e771fc9d22951d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.644282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8ca5830a8c455098e771fc9d22951d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.662724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:27.663812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:27.664344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:27.664825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:27.665769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:27.667765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8ca5830a8c455098e771fc9d22951d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:27.668408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:27.672288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:27.678529 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 956/1903] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:27 2022] DELETE /identity/v3/users/be8ca5830a8c455098e771fc9d22951d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:27.701685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 948/1904] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:27.702916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:27.705085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:27.829281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc0f59-718b-44e0-9516-701e5a73f80b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:27.836371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8408-865c-4989-812a-349bb7371134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:27.837061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8408-865c-4989-812a-349bb7371134 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:27.837352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8408-865c-4989-812a-349bb7371134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:27.837603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8408-865c-4989-812a-349bb7371134 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:27.838317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f8408-865c-4989-812a-349bb7371134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:27.840275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f8408-865c-4989-812a-349bb7371134 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:27.872276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 957/1905] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:27 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:27.876718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:27.896175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c7f4-0c41-4739-b660-0b1d1f778c12 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:27.986144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa15a0b-9f20-4acb-8ebb-7e33eb0e924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:27.987573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa15a0b-9f20-4acb-8ebb-7e33eb0e924d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:27.988051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa15a0b-9f20-4acb-8ebb-7e33eb0e924d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:27.988442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa15a0b-9f20-4acb-8ebb-7e33eb0e924d admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:27.989783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa15a0b-9f20-4acb-8ebb-7e33eb0e924d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:27.998948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa15a0b-9f20-4acb-8ebb-7e33eb0e924d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.047269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 949/1906] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:27 2022] POST /identity/v3/users => generated 305 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:28.050076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8408-865c-4989-812a-349bb7371134 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.062123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8408-865c-4989-812a-349bb7371134 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.067661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628906c-0c1a-4b5d-b282-c8cf4dcf722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.068363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628906c-0c1a-4b5d-b282-c8cf4dcf722b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.068709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628906c-0c1a-4b5d-b282-c8cf4dcf722b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.069048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628906c-0c1a-4b5d-b282-c8cf4dcf722b admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.070113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628906c-0c1a-4b5d-b282-c8cf4dcf722b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.071968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628906c-0c1a-4b5d-b282-c8cf4dcf722b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.086925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 958/1907] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:28.088566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa15a0b-9f20-4acb-8ebb-7e33eb0e924d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.099683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa15a0b-9f20-4acb-8ebb-7e33eb0e924d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.104482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c28eff-ea9e-432c-955d-6cdb6e6361cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.105230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c28eff-ea9e-432c-955d-6cdb6e6361cd admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.105596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c28eff-ea9e-432c-955d-6cdb6e6361cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.105935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c28eff-ea9e-432c-955d-6cdb6e6361cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.107342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c28eff-ea9e-432c-955d-6cdb6e6361cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.108668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c28eff-ea9e-432c-955d-6cdb6e6361cd admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.122992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 950/1908] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:28.127032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628906c-0c1a-4b5d-b282-c8cf4dcf722b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.138106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628906c-0c1a-4b5d-b282-c8cf4dcf722b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.143008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.144114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.144460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.145333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] PATH_INFO: `/v3/projects/ab463d833e3249e99359df73a96a9668/users/a2c60d6d6c2a4ec1a11ee966b16f164a/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.161614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab463d833e3249e99359df73a96a9668, user_id=a2c60d6d6c2a4ec1a11ee966b16f164a, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.165203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.182341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 959/1909] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:28 2022] PUT /identity/v3/projects/ab463d833e3249e99359df73a96a9668/users/a2c60d6d6c2a4ec1a11ee966b16f164a/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:28.193648 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c01af-e099-42a3-a7ec-249622849880 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.193942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c01af-e099-42a3-a7ec-249622849880 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.194485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c01af-e099-42a3-a7ec-249622849880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.233094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-477c01af-e099-42a3-a7ec-249622849880 None None] MFA Rules not processed for user `a2c60d6d6c2a4ec1a11ee966b16f164a`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:28.235140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-477c01af-e099-42a3-a7ec-249622849880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.256007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.257693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.334591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 951/1910] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:28.339011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c01af-e099-42a3-a7ec-249622849880 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.353901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828dc6-eb1d-4607-b145-8a733f79b162 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.358593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.359510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.360066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.360066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] PATH_INFO: `/v3/projects/1114708b75cb4fcc9548da9a1772f124` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.361227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1114708b75cb4fcc9548da9a1772f124)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.363142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.417516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1114708b75cb4fcc9548da9a1772f124', 'request_id': 'req-11200b48-7673-4391-ae28-4928e041b240'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.427672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c01af-e099-42a3-a7ec-249622849880 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.427989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1114708b75cb4fcc9548da9a1772f124', 'request_id': 'req-11200b48-7673-4391-ae28-4928e041b240'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.434745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1114708b75cb4fcc9548da9a1772f124', 'request_id': 'req-11200b48-7673-4391-ae28-4928e041b240'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.453539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] The token cache is being invalidate because project 1114708b75cb4fcc9548da9a1772f124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:28.454059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.454899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11200b48-7673-4391-ae28-4928e041b240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.461464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 960/1911] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:28 2022] DELETE /identity/v3/projects/1114708b75cb4fcc9548da9a1772f124 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:28.463258 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a433dd-7446-4f84-8598-d82b7cb38427 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.463723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a433dd-7446-4f84-8598-d82b7cb38427 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.464150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a433dd-7446-4f84-8598-d82b7cb38427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.490774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-21a433dd-7446-4f84-8598-d82b7cb38427 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:28.491576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-21a433dd-7446-4f84-8598-d82b7cb38427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.527470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.528253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.528601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.528989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.530033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.532102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.579636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 952/1912] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:28 2022] POST /identity/v3/projects => generated 409 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:28.584096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.585971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.587322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 961/1913] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:28.594929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72eef-c37d-4374-9d97-596796136910 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.595274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72eef-c37d-4374-9d97-596796136910 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.595669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72eef-c37d-4374-9d97-596796136910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.614941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8fd72eef-c37d-4374-9d97-596796136910 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:28.616333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8fd72eef-c37d-4374-9d97-596796136910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.652488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf83591-7978-440c-ae83-e0c051bb5463 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.658067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c7f26-66c4-4afd-8130-4b639fd52397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.658734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7f26-66c4-4afd-8130-4b639fd52397 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.659014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7f26-66c4-4afd-8130-4b639fd52397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.659287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c7f26-66c4-4afd-8130-4b639fd52397 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.660004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c7f26-66c4-4afd-8130-4b639fd52397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.661972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c7f26-66c4-4afd-8130-4b639fd52397 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.681869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 962/1914] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:28.685352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 953/1915] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:28 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:28.685491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd72eef-c37d-4374-9d97-596796136910 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.685800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c7f26-66c4-4afd-8130-4b639fd52397 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.686376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8fd72eef-c37d-4374-9d97-596796136910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.696125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c7f26-66c4-4afd-8130-4b639fd52397 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.698698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd72eef-c37d-4374-9d97-596796136910 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.700709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.701340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.701617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.701887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.702595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:28.702896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.703580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.704448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.704557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.704705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.704974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] PATH_INFO: `/v3/users/7d53cbbb443d45cdb99644bdf921c008` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.706171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d53cbbb443d45cdb99644bdf921c008)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.708669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.720131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 954/1916] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:58:28.720131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.733445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532f8d8-2096-404f-9627-de1cd278537d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.738788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc54ffa-4405-432a-9c56-6b6c431b5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.739686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54ffa-4405-432a-9c56-6b6c431b5bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.740132 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54ffa-4405-432a-9c56-6b6c431b5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.740408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54ffa-4405-432a-9c56-6b6c431b5bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.741188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc54ffa-4405-432a-9c56-6b6c431b5bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.742714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc54ffa-4405-432a-9c56-6b6c431b5bc4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.753443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 955/1917] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:28.753988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc54ffa-4405-432a-9c56-6b6c431b5bc4 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.763071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d53cbbb443d45cdb99644bdf921c008'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.764998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc54ffa-4405-432a-9c56-6b6c431b5bc4 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.771076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d53cbbb443d45cdb99644bdf921c008'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.772757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7cd3a-0292-44a3-85ba-73380e56e69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.773369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cd3a-0292-44a3-85ba-73380e56e69b admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.773982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cd3a-0292-44a3-85ba-73380e56e69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.773982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cd3a-0292-44a3-85ba-73380e56e69b admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.774619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7cd3a-0292-44a3-85ba-73380e56e69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.776634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7cd3a-0292-44a3-85ba-73380e56e69b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.779419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d53cbbb443d45cdb99644bdf921c008'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.780059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d53cbbb443d45cdb99644bdf921c008'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.794095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d53cbbb443d45cdb99644bdf921c008'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:28.800681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 963/1918] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:28 2022] DELETE /identity/v3/users/7d53cbbb443d45cdb99644bdf921c008 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:28.803554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 956/1919] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:28 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:28.805071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.805429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f033-0570-4684-8022-c76e6f43e17e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.805789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f033-0570-4684-8022-c76e6f43e17e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.806552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f033-0570-4684-8022-c76e6f43e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.807506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.827334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a703f033-0570-4684-8022-c76e6f43e17e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:28.829064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a703f033-0570-4684-8022-c76e6f43e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.894820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65afb1-0ef6-4a8f-beb0-2e2101049ea9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.915095 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 957/1920] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:28.915746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703f033-0570-4684-8022-c76e6f43e17e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.918863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a703f033-0570-4684-8022-c76e6f43e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.932577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703f033-0570-4684-8022-c76e6f43e17e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:28.938958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.939730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.940158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.940554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.941609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:28.945429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:28.975755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 958/1921] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:28 2022] POST /identity/v3/users => generated 286 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:28.976516 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:28.976845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29d4b-1de5-4956-b351-bdaa8c361904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:28.977908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29d4b-1de5-4956-b351-bdaa8c361904 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:28.978365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29d4b-1de5-4956-b351-bdaa8c361904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:28.978875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29d4b-1de5-4956-b351-bdaa8c361904 admin admin] PATH_INFO: `/v3/projects/3948355cf9e541ada135dfa72992bfcb/users/842185cd983b493b9c3fda86ae0bd7f2/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:28.982660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:28.998547 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29d4b-1de5-4956-b351-bdaa8c361904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3948355cf9e541ada135dfa72992bfcb, user_id=842185cd983b493b9c3fda86ae0bd7f2, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.001772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29d4b-1de5-4956-b351-bdaa8c361904 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.022996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 964/1922] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:28 2022] PUT /identity/v3/projects/3948355cf9e541ada135dfa72992bfcb/users/842185cd983b493b9c3fda86ae0bd7f2/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:29.023662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29d4b-1de5-4956-b351-bdaa8c361904 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.040382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78700c-7a80-4a8e-9df0-e7754e5030fe admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.083138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29d4b-1de5-4956-b351-bdaa8c361904 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.087367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351f5fd-1d22-4e6c-9d2c-59d77765576c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.088013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351f5fd-1d22-4e6c-9d2c-59d77765576c service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.088157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8e30-acd0-4363-857a-646bb53825b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.088287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351f5fd-1d22-4e6c-9d2c-59d77765576c service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.088555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351f5fd-1d22-4e6c-9d2c-59d77765576c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.088815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8e30-acd0-4363-857a-646bb53825b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.089095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8e30-acd0-4363-857a-646bb53825b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.089366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8e30-acd0-4363-857a-646bb53825b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.090090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac8e30-acd0-4363-857a-646bb53825b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.091781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac8e30-acd0-4363-857a-646bb53825b0 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.097573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351f5fd-1d22-4e6c-9d2c-59d77765576c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.099042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351f5fd-1d22-4e6c-9d2c-59d77765576c service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.101415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 965/1923] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:29.102203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8e30-acd0-4363-857a-646bb53825b0 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.110312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 959/1924] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:29.111178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351f5fd-1d22-4e6c-9d2c-59d77765576c service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.112222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8e30-acd0-4363-857a-646bb53825b0 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.118713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817227e-bf1a-4ec2-b8bc-5e409adf7f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.119405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817227e-bf1a-4ec2-b8bc-5e409adf7f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.119681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817227e-bf1a-4ec2-b8bc-5e409adf7f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.119953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817227e-bf1a-4ec2-b8bc-5e409adf7f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.120669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351f5fd-1d22-4e6c-9d2c-59d77765576c service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.120785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817227e-bf1a-4ec2-b8bc-5e409adf7f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.122246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817227e-bf1a-4ec2-b8bc-5e409adf7f24 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.125225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d4833-7fc8-4f4c-9c05-f4820c0f1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.125867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d4833-7fc8-4f4c-9c05-f4820c0f1727 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.126140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d4833-7fc8-4f4c-9c05-f4820c0f1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.126406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d4833-7fc8-4f4c-9c05-f4820c0f1727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.127137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d4833-7fc8-4f4c-9c05-f4820c0f1727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.128722 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d4833-7fc8-4f4c-9c05-f4820c0f1727 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.133183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 966/1925] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:29.136816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817227e-bf1a-4ec2-b8bc-5e409adf7f24 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.139648 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 960/1926] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:29.143601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d4833-7fc8-4f4c-9c05-f4820c0f1727 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.146606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817227e-bf1a-4ec2-b8bc-5e409adf7f24 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.151448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ceea3-f1ce-4670-ac6b-553c2ad87839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.152332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ceea3-f1ce-4670-ac6b-553c2ad87839 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.152601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ceea3-f1ce-4670-ac6b-553c2ad87839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.152874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ceea3-f1ce-4670-ac6b-553c2ad87839 admin admin] PATH_INFO: `/v3/projects/3948355cf9e541ada135dfa72992bfcb/users/842185cd983b493b9c3fda86ae0bd7f2/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.153616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d4833-7fc8-4f4c-9c05-f4820c0f1727 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.154986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ceea3-f1ce-4670-ac6b-553c2ad87839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3948355cf9e541ada135dfa72992bfcb, user_id=842185cd983b493b9c3fda86ae0bd7f2, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.157779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ceea3-f1ce-4670-ac6b-553c2ad87839 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.159276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be382c-6159-4494-a194-1228d0ebc58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.160315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be382c-6159-4494-a194-1228d0ebc58d admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.160720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be382c-6159-4494-a194-1228d0ebc58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.160995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be382c-6159-4494-a194-1228d0ebc58d admin admin] PATH_INFO: `/v3/projects/335338c6d5e740d0b388702462e552ef/users/04109028620d4b7284fbd32efc695c56/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.169971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 967/1927] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:29 2022] PUT /identity/v3/projects/3948355cf9e541ada135dfa72992bfcb/users/842185cd983b493b9c3fda86ae0bd7f2/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:29.180987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e59d-6872-452d-a5b0-646dc40f8e3f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.181274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e59d-6872-452d-a5b0-646dc40f8e3f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.181550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e59d-6872-452d-a5b0-646dc40f8e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.184755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be382c-6159-4494-a194-1228d0ebc58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=335338c6d5e740d0b388702462e552ef, user_id=04109028620d4b7284fbd32efc695c56, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.187932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be382c-6159-4494-a194-1228d0ebc58d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.204823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 961/1928] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:29 2022] PUT /identity/v3/projects/335338c6d5e740d0b388702462e552ef/users/04109028620d4b7284fbd32efc695c56/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:29.209734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a6a75-62ff-4da9-a88b-615b4edeefc4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.210018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a6a75-62ff-4da9-a88b-615b4edeefc4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.210744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a6a75-62ff-4da9-a88b-615b4edeefc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.218389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f335e59d-6872-452d-a5b0-646dc40f8e3f None None] MFA Rules not processed for user `842185cd983b493b9c3fda86ae0bd7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:29.220030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f335e59d-6872-452d-a5b0-646dc40f8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:29.229327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-195a6a75-62ff-4da9-a88b-615b4edeefc4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:29.230461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-195a6a75-62ff-4da9-a88b-615b4edeefc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:29.295283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 968/1930] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:29 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:29.296015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 962/1930] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:29.305853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335e59d-6872-452d-a5b0-646dc40f8e3f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.308328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f335e59d-6872-452d-a5b0-646dc40f8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:29.311230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a6a75-62ff-4da9-a88b-615b4edeefc4 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.312825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-195a6a75-62ff-4da9-a88b-615b4edeefc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:29.383671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335e59d-6872-452d-a5b0-646dc40f8e3f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.387331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a4f55-735f-4430-a085-d19383237401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.387990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a4f55-735f-4430-a085-d19383237401 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.388267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a4f55-735f-4430-a085-d19383237401 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.388539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a4f55-735f-4430-a085-d19383237401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.389810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a6a75-62ff-4da9-a88b-615b4edeefc4 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.393500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.394247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.394661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.394966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.398218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a4f55-735f-4430-a085-d19383237401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.399705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a4f55-735f-4430-a085-d19383237401 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.405606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.407033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.412895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 969/1931] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:29.417960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 963/1932] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:29.647060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a4f55-735f-4430-a085-d19383237401 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.670150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a4f55-735f-4430-a085-d19383237401 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.679027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeafdfe-23a5-41c9-b51d-df9b821daeb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.679717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeafdfe-23a5-41c9-b51d-df9b821daeb8 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.680001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeafdfe-23a5-41c9-b51d-df9b821daeb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.680276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeafdfe-23a5-41c9-b51d-df9b821daeb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.686489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1aeafdfe-23a5-41c9-b51d-df9b821daeb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:29.772568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeafdfe-23a5-41c9-b51d-df9b821daeb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.776431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeafdfe-23a5-41c9-b51d-df9b821daeb8 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.794320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 970/1933] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:29.843452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:29.845381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:29.861786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085d7a-73f9-4515-9d72-73613856aba9 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:29.866745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:29.867537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:29.867819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:29.868090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] PATH_INFO: `/v3/projects/f3a825353a7e49549e4694bc0ccbdd80` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:29.873625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a825353a7e49549e4694bc0ccbdd80)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:29.875429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:29.970547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a825353a7e49549e4694bc0ccbdd80', 'request_id': 'req-50371d20-6e36-4de6-b5da-bb6d36e23754'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:29.979362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a825353a7e49549e4694bc0ccbdd80', 'request_id': 'req-50371d20-6e36-4de6-b5da-bb6d36e23754'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:29.992920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a825353a7e49549e4694bc0ccbdd80', 'request_id': 'req-50371d20-6e36-4de6-b5da-bb6d36e23754'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:30.009197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] The token cache is being invalidate because project f3a825353a7e49549e4694bc0ccbdd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:30.009483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:30.011604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50371d20-6e36-4de6-b5da-bb6d36e23754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:30.014026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 964/1934] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:29 2022] DELETE /identity/v3/projects/f3a825353a7e49549e4694bc0ccbdd80 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:30.019239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f18b7-9517-4f01-a51b-a7fbc113a7ed None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.019597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f18b7-9517-4f01-a51b-a7fbc113a7ed None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.020637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f18b7-9517-4f01-a51b-a7fbc113a7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.045948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a35f18b7-9517-4f01-a51b-a7fbc113a7ed None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:30.047106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a35f18b7-9517-4f01-a51b-a7fbc113a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:30.119265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 971/1935] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:30.128041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c2fd7-9df6-4ae4-93b5-fc7c26fc46e9 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.128732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c2fd7-9df6-4ae4-93b5-fc7c26fc46e9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.129820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c2fd7-9df6-4ae4-93b5-fc7c26fc46e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.161648 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b62c2fd7-9df6-4ae4-93b5-fc7c26fc46e9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:30.163477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b62c2fd7-9df6-4ae4-93b5-fc7c26fc46e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:30.186364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 965/1936] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:30.187681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f18b7-9517-4f01-a51b-a7fbc113a7ed None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:30.225910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f18b7-9517-4f01-a51b-a7fbc113a7ed None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:30.231834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:30.233259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.235278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.235658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.236506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:30.236883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:30.239334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:30.266234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c2fd7-9df6-4ae4-93b5-fc7c26fc46e9 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:30.267478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 972/1937] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:30.288533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c2fd7-9df6-4ae4-93b5-fc7c26fc46e9 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:30.293964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a401ebb-dc1c-49ce-a09b-2661483a87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:30.294737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401ebb-dc1c-49ce-a09b-2661483a87a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.295077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401ebb-dc1c-49ce-a09b-2661483a87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.295476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401ebb-dc1c-49ce-a09b-2661483a87a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.296274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a401ebb-dc1c-49ce-a09b-2661483a87a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:30.298340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a401ebb-dc1c-49ce-a09b-2661483a87a7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:30.326718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 966/1938] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:30 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:30.330924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:30.341854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a49a9-2e56-43dd-bd6f-8d22d09293f3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:30.357372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10321c-16fe-44fd-9d61-7e7932bec70e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.358027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10321c-16fe-44fd-9d61-7e7932bec70e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.358027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10321c-16fe-44fd-9d61-7e7932bec70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.385425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ef10321c-16fe-44fd-9d61-7e7932bec70e None None] MFA Rules not processed for user `04109028620d4b7284fbd32efc695c56`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:30.386671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ef10321c-16fe-44fd-9d61-7e7932bec70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:30.405523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c799-94d8-4f15-b870-cf7ec0afd0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:30.406311 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c799-94d8-4f15-b870-cf7ec0afd0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.406664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c799-94d8-4f15-b870-cf7ec0afd0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.406998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c799-94d8-4f15-b870-cf7ec0afd0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.407790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c799-94d8-4f15-b870-cf7ec0afd0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:30.409701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c799-94d8-4f15-b870-cf7ec0afd0a8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:30.438519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 973/1939] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:30 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:30.439554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c799-94d8-4f15-b870-cf7ec0afd0a8 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:30.451140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c799-94d8-4f15-b870-cf7ec0afd0a8 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:30.456961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377b6a-dac9-43fb-b702-1f4fb46714d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:30.457674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377b6a-dac9-43fb-b702-1f4fb46714d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.457952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377b6a-dac9-43fb-b702-1f4fb46714d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.458655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377b6a-dac9-43fb-b702-1f4fb46714d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.459476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06377b6a-dac9-43fb-b702-1f4fb46714d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:30.460720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 967/1940] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:30.464083 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06377b6a-dac9-43fb-b702-1f4fb46714d5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:30.471643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10321c-16fe-44fd-9d61-7e7932bec70e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:30.473049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ef10321c-16fe-44fd-9d61-7e7932bec70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:30.476041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 974/1941] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:30.479675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377b6a-dac9-43fb-b702-1f4fb46714d5 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:30.493221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377b6a-dac9-43fb-b702-1f4fb46714d5 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:30.498338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad97b-15da-4bdb-9ba1-0f0dd642da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:30.499089 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad97b-15da-4bdb-9ba1-0f0dd642da46 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.499818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad97b-15da-4bdb-9ba1-0f0dd642da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.499818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ad97b-15da-4bdb-9ba1-0f0dd642da46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.500723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ad97b-15da-4bdb-9ba1-0f0dd642da46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:30.502459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ad97b-15da-4bdb-9ba1-0f0dd642da46 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:30.520130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 975/1942] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:30.521398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad97b-15da-4bdb-9ba1-0f0dd642da46 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:30.534861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ad97b-15da-4bdb-9ba1-0f0dd642da46 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:30.536424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10321c-16fe-44fd-9d61-7e7932bec70e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:30.539712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:30.540105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999792e-b340-4918-b052-7f10380c4fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:30.540657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.540749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999792e-b340-4918-b052-7f10380c4fdd service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.540934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.541030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999792e-b340-4918-b052-7f10380c4fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.541204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] PATH_INFO: `/v3/projects/f314e44c3a114e8f83fbe1909d95cd77/users/f87019bbbabb4127ad5a188b12446970/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.541293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999792e-b340-4918-b052-7f10380c4fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.550233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999792e-b340-4918-b052-7f10380c4fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:30.552222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999792e-b340-4918-b052-7f10380c4fdd service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:30.556522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f314e44c3a114e8f83fbe1909d95cd77, user_id=f87019bbbabb4127ad5a188b12446970, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:30.559404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:30.561640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 968/1943] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:58:30.573678 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 976/1944] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:30 2022] PUT /identity/v3/projects/f314e44c3a114e8f83fbe1909d95cd77/users/f87019bbbabb4127ad5a188b12446970/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:30.584472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114020f-f6c1-42b9-be5b-6fa0808e53b2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.584868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114020f-f6c1-42b9-be5b-6fa0808e53b2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.585154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114020f-f6c1-42b9-be5b-6fa0808e53b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.610898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9114020f-f6c1-42b9-be5b-6fa0808e53b2 None None] MFA Rules not processed for user `f87019bbbabb4127ad5a188b12446970`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:30.612261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9114020f-f6c1-42b9-be5b-6fa0808e53b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:30.678343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 969/1945] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:30.689389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:30.691125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:30.759682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15800f-1506-40c2-b2db-61db8104783d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:30.763831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aa999-24fc-4205-8192-043e2139d59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:30.764631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa999-24fc-4205-8192-043e2139d59d service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:30.764910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa999-24fc-4205-8192-043e2139d59d service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:30.765180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa999-24fc-4205-8192-043e2139d59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:30.775377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aa999-24fc-4205-8192-043e2139d59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:30.776759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aa999-24fc-4205-8192-043e2139d59d service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:30.798772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 977/1946] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:31.929901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623bc30-9ffc-46be-8c81-e6965a5e7346 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:31.930432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623bc30-9ffc-46be-8c81-e6965a5e7346 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:31.930432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623bc30-9ffc-46be-8c81-e6965a5e7346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:31.948533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-f623bc30-9ffc-46be-8c81-e6965a5e7346 None None] MFA Rules not processed for user `04109028620d4b7284fbd32efc695c56`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:31.949837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f623bc30-9ffc-46be-8c81-e6965a5e7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:32.003717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 970/1947] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:36.573836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aa999-24fc-4205-8192-043e2139d59d service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:36.668137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aa999-24fc-4205-8192-043e2139d59d service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:36.672905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:36.673782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:36.674056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:36.674356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] PATH_INFO: `/v3/users/f87019bbbabb4127ad5a188b12446970` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:36.675668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87019bbbabb4127ad5a188b12446970)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:36.677805 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:36.735058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87019bbbabb4127ad5a188b12446970'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:36.742427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87019bbbabb4127ad5a188b12446970'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:36.751208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87019bbbabb4127ad5a188b12446970'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:36.751883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87019bbbabb4127ad5a188b12446970'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:36.776253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87019bbbabb4127ad5a188b12446970'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:36.787370 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 978/1948] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:36 2022] DELETE /identity/v3/users/f87019bbbabb4127ad5a188b12446970 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:36.789801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a7b9-80d1-45dc-b629-687c598c06e3 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:36.790296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a7b9-80d1-45dc-b629-687c598c06e3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:36.790396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a7b9-80d1-45dc-b629-687c598c06e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:36.808721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-fbd5a7b9-80d1-45dc-b629-687c598c06e3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:36.809947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-fbd5a7b9-80d1-45dc-b629-687c598c06e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:36.871126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 971/1949] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:36.881328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:36.882738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:36.942756 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c90079-65ca-4bfd-9f29-b563b7259cf1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:36.947432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26ad66-d265-4510-8a76-bbdd135bb764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:36.948190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ad66-d265-4510-8a76-bbdd135bb764 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:36.948538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ad66-d265-4510-8a76-bbdd135bb764 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:36.948881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ad66-d265-4510-8a76-bbdd135bb764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:36.960205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26ad66-d265-4510-8a76-bbdd135bb764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:36.961654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26ad66-d265-4510-8a76-bbdd135bb764 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:36.972137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 979/1950] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:37.288109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5a7b9-80d1-45dc-b629-687c598c06e3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:37.289990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-fbd5a7b9-80d1-45dc-b629-687c598c06e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:37.307587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5a7b9-80d1-45dc-b629-687c598c06e3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:37.315818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:37.318251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.318636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.319702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] PATH_INFO: `/v3/projects/f314e44c3a114e8f83fbe1909d95cd77` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.323643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f314e44c3a114e8f83fbe1909d95cd77)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:37.325882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:37.424324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f314e44c3a114e8f83fbe1909d95cd77', 'request_id': 'req-04e5ba7d-e757-4d69-8d0f-a3942e868790'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:37.431823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f314e44c3a114e8f83fbe1909d95cd77', 'request_id': 'req-04e5ba7d-e757-4d69-8d0f-a3942e868790'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:37.442583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f314e44c3a114e8f83fbe1909d95cd77', 'request_id': 'req-04e5ba7d-e757-4d69-8d0f-a3942e868790'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:37.463743 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] The token cache is being invalidate because project f314e44c3a114e8f83fbe1909d95cd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:37.464274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:37.465128 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-04e5ba7d-e757-4d69-8d0f-a3942e868790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:37.466948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 972/1951] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:37 2022] DELETE /identity/v3/projects/f314e44c3a114e8f83fbe1909d95cd77 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:37.472223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8f5e-ce2c-4291-b999-e59b2600670f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.472672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8f5e-ce2c-4291-b999-e59b2600670f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.473124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8f5e-ce2c-4291-b999-e59b2600670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.493313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3a9b8f5e-ce2c-4291-b999-e59b2600670f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:37.494768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3a9b8f5e-ce2c-4291-b999-e59b2600670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:37.595824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 980/1952] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:37.598209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46f13-8a24-4540-bece-11c771b4ca73 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.598593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46f13-8a24-4540-bece-11c771b4ca73 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.599665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46f13-8a24-4540-bece-11c771b4ca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.621995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-54a46f13-8a24-4540-bece-11c771b4ca73 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:37.623391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-54a46f13-8a24-4540-bece-11c771b4ca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:37.631793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 973/1953] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:37.636995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b8f5e-ce2c-4291-b999-e59b2600670f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:37.649486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b8f5e-ce2c-4291-b999-e59b2600670f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:37.654083 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:37.654755 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.655036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.655319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.656075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:37.656380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:37.658251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:37.672119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 981/1954] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:58:37.677039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a46f13-8a24-4540-bece-11c771b4ca73 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:37.686288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a46f13-8a24-4540-bece-11c771b4ca73 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:37.690933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6969506-8085-43c5-8355-79bcdb051310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:37.691662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6969506-8085-43c5-8355-79bcdb051310 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.691941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6969506-8085-43c5-8355-79bcdb051310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.692215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6969506-8085-43c5-8355-79bcdb051310 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.692945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6969506-8085-43c5-8355-79bcdb051310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:37.695136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6969506-8085-43c5-8355-79bcdb051310 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:37.721096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 974/1955] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:37 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:58:37.725876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:37.735785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a608ac-5040-4df9-b04c-d4a9094060f8 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:37.790560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51236-a25a-4192-9523-3bbcc06a6f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:37.791145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51236-a25a-4192-9523-3bbcc06a6f66 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.791676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51236-a25a-4192-9523-3bbcc06a6f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.791859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51236-a25a-4192-9523-3bbcc06a6f66 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.793554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca51236-a25a-4192-9523-3bbcc06a6f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:37.795662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca51236-a25a-4192-9523-3bbcc06a6f66 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:37.822350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 982/1956] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:37 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:37.826291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6969506-8085-43c5-8355-79bcdb051310 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:37.836757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6969506-8085-43c5-8355-79bcdb051310 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:37.841566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea9606-14bc-4d4a-967d-6087bb5783a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:37.842232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea9606-14bc-4d4a-967d-6087bb5783a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.842511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea9606-14bc-4d4a-967d-6087bb5783a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.842786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea9606-14bc-4d4a-967d-6087bb5783a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.843579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea9606-14bc-4d4a-967d-6087bb5783a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:37.845190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea9606-14bc-4d4a-967d-6087bb5783a8 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:37.857507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 975/1957] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:37.861645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51236-a25a-4192-9523-3bbcc06a6f66 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:37.873095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51236-a25a-4192-9523-3bbcc06a6f66 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:37.877890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56924220-c1dc-4b65-9671-936a7ee842ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:37.878547 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56924220-c1dc-4b65-9671-936a7ee842ee admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.878828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56924220-c1dc-4b65-9671-936a7ee842ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.879128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56924220-c1dc-4b65-9671-936a7ee842ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.879885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56924220-c1dc-4b65-9671-936a7ee842ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:37.881479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56924220-c1dc-4b65-9671-936a7ee842ee admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:37.895065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 983/1958] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:37.896194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea9606-14bc-4d4a-967d-6087bb5783a8 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:37.906227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea9606-14bc-4d4a-967d-6087bb5783a8 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:37.911534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:37.912439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.912720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.912997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] PATH_INFO: `/v3/projects/c6ef1c88946b43a4a38adb2597263432/users/8522fa28726b4abbbc022de1c37fee11/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.929651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ef1c88946b43a4a38adb2597263432, user_id=8522fa28726b4abbbc022de1c37fee11, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:37.933260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:37.948173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 976/1959] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:37 2022] PUT /identity/v3/projects/c6ef1c88946b43a4a38adb2597263432/users/8522fa28726b4abbbc022de1c37fee11/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:37.959768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c55d5-c634-4a38-9d5d-cc0f2a536986 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:37.960803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c55d5-c634-4a38-9d5d-cc0f2a536986 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:37.961305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c55d5-c634-4a38-9d5d-cc0f2a536986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:37.992404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c74c55d5-c634-4a38-9d5d-cc0f2a536986 None None] MFA Rules not processed for user `8522fa28726b4abbbc022de1c37fee11`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:37.993602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c74c55d5-c634-4a38-9d5d-cc0f2a536986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:38.060098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 984/1960] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:38.070950 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:38.072775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:38.149175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4f7da-1b2d-43d6-b5e9-1cab20b27b64 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:38.154569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5589c13-86b0-4b94-a97a-530c26d0691a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:38.155455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589c13-86b0-4b94-a97a-530c26d0691a service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:38.159590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589c13-86b0-4b94-a97a-530c26d0691a service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:38.159901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589c13-86b0-4b94-a97a-530c26d0691a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:38.171023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5589c13-86b0-4b94-a97a-530c26d0691a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:38.172962 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5589c13-86b0-4b94-a97a-530c26d0691a service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:38.183712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 977/1961] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:39.384393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c55d5-c634-4a38-9d5d-cc0f2a536986 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:39.386527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c74c55d5-c634-4a38-9d5d-cc0f2a536986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:39.463921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c55d5-c634-4a38-9d5d-cc0f2a536986 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:39.469640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:39.470782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:39.471138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:39.471509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] PATH_INFO: `/v3/users/a2c60d6d6c2a4ec1a11ee966b16f164a` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:39.473397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c60d6d6c2a4ec1a11ee966b16f164a)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:39.475486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:39.543569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c60d6d6c2a4ec1a11ee966b16f164a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:39.553500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c60d6d6c2a4ec1a11ee966b16f164a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:39.564111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c60d6d6c2a4ec1a11ee966b16f164a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:39.565288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c60d6d6c2a4ec1a11ee966b16f164a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:39.581892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aadfd445-ddb1-4bcf-8e31-b547ef15dee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c60d6d6c2a4ec1a11ee966b16f164a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:39.592669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 985/1962] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:39 2022] DELETE /identity/v3/users/a2c60d6d6c2a4ec1a11ee966b16f164a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:39.597701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743299-a6a2-47e9-a8b3-2b2eef11c61a None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:39.599408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743299-a6a2-47e9-a8b3-2b2eef11c61a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:39.599966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743299-a6a2-47e9-a8b3-2b2eef11c61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:39.625897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-09743299-a6a2-47e9-a8b3-2b2eef11c61a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:39.627433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-09743299-a6a2-47e9-a8b3-2b2eef11c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:39.685293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414424-8850-4d1a-8d61-88da35cc3523 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:39.685560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414424-8850-4d1a-8d61-88da35cc3523 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:39.685850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414424-8850-4d1a-8d61-88da35cc3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:39.727434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-28414424-8850-4d1a-8d61-88da35cc3523 None None] MFA Rules not processed for user `8522fa28726b4abbbc022de1c37fee11`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:39.731980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-28414424-8850-4d1a-8d61-88da35cc3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:39.815798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 978/1963] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:39.824347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 986/1964] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:39.828309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743299-a6a2-47e9-a8b3-2b2eef11c61a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:39.829906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-09743299-a6a2-47e9-a8b3-2b2eef11c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:39.911931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743299-a6a2-47e9-a8b3-2b2eef11c61a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:39.915611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec22b-f46a-47fa-8926-f0556f2efe5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:39.916326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec22b-f46a-47fa-8926-f0556f2efe5c service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:39.916672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec22b-f46a-47fa-8926-f0556f2efe5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:39.917029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec22b-f46a-47fa-8926-f0556f2efe5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:39.927392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ec22b-f46a-47fa-8926-f0556f2efe5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:39.928933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ec22b-f46a-47fa-8926-f0556f2efe5c service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:39.939454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 979/1965] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:40.755465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414424-8850-4d1a-8d61-88da35cc3523 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:40.758129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-28414424-8850-4d1a-8d61-88da35cc3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:40.773985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414424-8850-4d1a-8d61-88da35cc3523 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:40.778810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:40.779845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:40.780127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:40.780415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] PATH_INFO: `/v3/projects/ab463d833e3249e99359df73a96a9668` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:40.781691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab463d833e3249e99359df73a96a9668)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:40.783826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:40.880874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab463d833e3249e99359df73a96a9668', 'request_id': 'req-597de799-edd0-49d2-a7fa-94cb09b959b5'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:40.889280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab463d833e3249e99359df73a96a9668', 'request_id': 'req-597de799-edd0-49d2-a7fa-94cb09b959b5'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:40.897661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab463d833e3249e99359df73a96a9668', 'request_id': 'req-597de799-edd0-49d2-a7fa-94cb09b959b5'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:40.914326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] The token cache is being invalidate because project ab463d833e3249e99359df73a96a9668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:40.914809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:40.915683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:40.921404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 987/1966] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:40 2022] DELETE /identity/v3/projects/ab463d833e3249e99359df73a96a9668 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:40.921774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec22b-f46a-47fa-8926-f0556f2efe5c service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:40.941338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec22b-f46a-47fa-8926-f0556f2efe5c service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:41.054874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:41.056492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:41.056492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:41.056777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] PATH_INFO: `/v3/users/842185cd983b493b9c3fda86ae0bd7f2` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:41.058894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=842185cd983b493b9c3fda86ae0bd7f2)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:41.060982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:41.159914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842185cd983b493b9c3fda86ae0bd7f2'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:41.177421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842185cd983b493b9c3fda86ae0bd7f2'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:41.180054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842185cd983b493b9c3fda86ae0bd7f2'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:41.197036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842185cd983b493b9c3fda86ae0bd7f2'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:41.198012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b51d6db4-3d80-4bcb-8f8e-df6415b47a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842185cd983b493b9c3fda86ae0bd7f2'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:41.279958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 980/1967] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:40 2022] DELETE /identity/v3/users/842185cd983b493b9c3fda86ae0bd7f2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:41.735951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:41.737758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:41.754381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de799-edd0-49d2-a7fa-94cb09b959b5 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:41.878807 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:41.879970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:41.880255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:41.880762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] PATH_INFO: `/v3/projects/3948355cf9e541ada135dfa72992bfcb` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:41.882418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3948355cf9e541ada135dfa72992bfcb)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:41.884714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:41.968121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3948355cf9e541ada135dfa72992bfcb', 'request_id': 'req-32d69d80-4d2e-44e2-bcfe-58facdcd345c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:41.986879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3948355cf9e541ada135dfa72992bfcb', 'request_id': 'req-32d69d80-4d2e-44e2-bcfe-58facdcd345c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:41.995949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3948355cf9e541ada135dfa72992bfcb', 'request_id': 'req-32d69d80-4d2e-44e2-bcfe-58facdcd345c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:42.020752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] The token cache is being invalidate because project 3948355cf9e541ada135dfa72992bfcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:42.023960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:42.025418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-32d69d80-4d2e-44e2-bcfe-58facdcd345c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:42.030533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 988/1968] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:41 2022] DELETE /identity/v3/projects/3948355cf9e541ada135dfa72992bfcb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:42.036528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635a2a-6f59-487b-b814-fe152628169e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.037259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635a2a-6f59-487b-b814-fe152628169e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.037259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635a2a-6f59-487b-b814-fe152628169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.080101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d3635a2a-6f59-487b-b814-fe152628169e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:42.081765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d3635a2a-6f59-487b-b814-fe152628169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:42.186906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 981/1969] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:42.188877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cdb78-3e30-453d-87a2-cd91f87500ad None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.189102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cdb78-3e30-453d-87a2-cd91f87500ad None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.189377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cdb78-3e30-453d-87a2-cd91f87500ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.216327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-699cdb78-3e30-453d-87a2-cd91f87500ad None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:42.217550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-699cdb78-3e30-453d-87a2-cd91f87500ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:42.231173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 989/1970] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:42.231798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3635a2a-6f59-487b-b814-fe152628169e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:42.241817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3635a2a-6f59-487b-b814-fe152628169e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:42.247287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:42.248132 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.248475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.248811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.249624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:42.250000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:42.251661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:42.268045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 982/1971] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 18:58:42.269380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cdb78-3e30-453d-87a2-cd91f87500ad None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:42.279894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cdb78-3e30-453d-87a2-cd91f87500ad None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:42.284713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f892-8a2c-4a2b-bd9e-0923aae3e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:42.285415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f892-8a2c-4a2b-bd9e-0923aae3e86f admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.285695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f892-8a2c-4a2b-bd9e-0923aae3e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.285968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f892-8a2c-4a2b-bd9e-0923aae3e86f admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.286683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63f892-8a2c-4a2b-bd9e-0923aae3e86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:42.288649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63f892-8a2c-4a2b-bd9e-0923aae3e86f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:42.315023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 990/1972] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:42 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:58:42.320245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:42.330214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dccf2-0075-4628-9a5b-af9adfc032c2 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:42.393557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0740-33b2-4a3e-8852-daaa8431153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:42.394232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0740-33b2-4a3e-8852-daaa8431153c admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.394533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0740-33b2-4a3e-8852-daaa8431153c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.394824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0740-33b2-4a3e-8852-daaa8431153c admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.395666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0740-33b2-4a3e-8852-daaa8431153c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:42.397506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0740-33b2-4a3e-8852-daaa8431153c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:42.426351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 983/1973] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:42 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:42.426427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f892-8a2c-4a2b-bd9e-0923aae3e86f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:42.437215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f892-8a2c-4a2b-bd9e-0923aae3e86f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:42.443046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11f76-fc7c-48c1-a0c2-fc60589d380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:42.443732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11f76-fc7c-48c1-a0c2-fc60589d380d admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.444012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11f76-fc7c-48c1-a0c2-fc60589d380d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.444538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11f76-fc7c-48c1-a0c2-fc60589d380d admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.445267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a11f76-fc7c-48c1-a0c2-fc60589d380d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:42.446873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a11f76-fc7c-48c1-a0c2-fc60589d380d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:42.468297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 991/1974] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:42.470093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0740-33b2-4a3e-8852-daaa8431153c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:42.481131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0740-33b2-4a3e-8852-daaa8431153c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:42.486779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba60607-0f81-4b1b-ad96-92dc3e7e4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:42.487486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba60607-0f81-4b1b-ad96-92dc3e7e4cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.487765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba60607-0f81-4b1b-ad96-92dc3e7e4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.488047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba60607-0f81-4b1b-ad96-92dc3e7e4cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.489399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba60607-0f81-4b1b-ad96-92dc3e7e4cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:42.491020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba60607-0f81-4b1b-ad96-92dc3e7e4cd3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:42.502700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 984/1975] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:42.506773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11f76-fc7c-48c1-a0c2-fc60589d380d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:42.532732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11f76-fc7c-48c1-a0c2-fc60589d380d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:42.546301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:42.547241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.547557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.547836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] PATH_INFO: `/v3/projects/64c98e7aaaee4a9c94b67b1d908e367c/users/9be267cc6c3b48c79560ceedf8ca9d88/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.576465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c98e7aaaee4a9c94b67b1d908e367c, user_id=9be267cc6c3b48c79560ceedf8ca9d88, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:42.579127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:42.593657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 992/1976] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:42 2022] PUT /identity/v3/projects/64c98e7aaaee4a9c94b67b1d908e367c/users/9be267cc6c3b48c79560ceedf8ca9d88/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:42.604586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00557133-48e5-472a-a1d3-a73d0c71f694 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.605163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00557133-48e5-472a-a1d3-a73d0c71f694 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.605440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00557133-48e5-472a-a1d3-a73d0c71f694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.660218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-00557133-48e5-472a-a1d3-a73d0c71f694 None None] MFA Rules not processed for user `9be267cc6c3b48c79560ceedf8ca9d88`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:42.661464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-00557133-48e5-472a-a1d3-a73d0c71f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:42.782823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 985/1977] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:42.791020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:42.792781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:42.874011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a0c62-906c-481b-8923-eb485f15cc74 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:42.889030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7275-a59f-4e7b-b7c5-0dba9c4be61a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:42.890445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7275-a59f-4e7b-b7c5-0dba9c4be61a service glance] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:42.892269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7275-a59f-4e7b-b7c5-0dba9c4be61a service glance] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:42.892663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7275-a59f-4e7b-b7c5-0dba9c4be61a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:42.911713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a7275-a59f-4e7b-b7c5-0dba9c4be61a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:42.916452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a7275-a59f-4e7b-b7c5-0dba9c4be61a service glance] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:42.936360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 993/1978] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:58:44.028509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00557133-48e5-472a-a1d3-a73d0c71f694 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:44.029982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-00557133-48e5-472a-a1d3-a73d0c71f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:44.149104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00557133-48e5-472a-a1d3-a73d0c71f694 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:44.153972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:44.154870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:44.155144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:44.155473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] PATH_INFO: `/v3/users/29349dabed5746449cefe237fd3739c3` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:44.156729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=29349dabed5746449cefe237fd3739c3)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:44.158745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:44.218581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29349dabed5746449cefe237fd3739c3'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.225268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29349dabed5746449cefe237fd3739c3'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.225924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29349dabed5746449cefe237fd3739c3'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.233140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29349dabed5746449cefe237fd3739c3'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.233671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f8f76342-97de-4e36-971e-283b921cb6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29349dabed5746449cefe237fd3739c3'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.255022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 986/1979] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:44 2022] DELETE /identity/v3/users/29349dabed5746449cefe237fd3739c3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:44.517441 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7275-a59f-4e7b-b7c5-0dba9c4be61a service glance] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:44.535928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7275-a59f-4e7b-b7c5-0dba9c4be61a service glance] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:44.593846 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:44.594666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:44.594945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:44.595244 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] PATH_INFO: `/v3/projects/2fbf31f703e849cfa03c63580dee547a` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:44.596460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbf31f703e849cfa03c63580dee547a)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:44.598971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:44.645323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbf31f703e849cfa03c63580dee547a', 'request_id': 'req-5563c1e3-d145-438d-9e92-0cb64eee753b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.652944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbf31f703e849cfa03c63580dee547a', 'request_id': 'req-5563c1e3-d145-438d-9e92-0cb64eee753b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.658545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbf31f703e849cfa03c63580dee547a', 'request_id': 'req-5563c1e3-d145-438d-9e92-0cb64eee753b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.670600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] The token cache is being invalidate because project 2fbf31f703e849cfa03c63580dee547a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:44.670884 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.671578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5563c1e3-d145-438d-9e92-0cb64eee753b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:44.673096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 994/1980] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:44 2022] DELETE /identity/v3/projects/2fbf31f703e849cfa03c63580dee547a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:44.678141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519809-05e0-478d-9f42-00ddc4d41f6c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:44.678430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519809-05e0-478d-9f42-00ddc4d41f6c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:44.678703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519809-05e0-478d-9f42-00ddc4d41f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:44.698136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c9519809-05e0-478d-9f42-00ddc4d41f6c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:44.701473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c9519809-05e0-478d-9f42-00ddc4d41f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:44.759870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 987/1981] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:44.767824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7a2e5-da93-45a3-a01d-08c2db6ecb0b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:44.768215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7a2e5-da93-45a3-a01d-08c2db6ecb0b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:44.768787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7a2e5-da93-45a3-a01d-08c2db6ecb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:44.788598 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-38b7a2e5-da93-45a3-a01d-08c2db6ecb0b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:44.789840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-38b7a2e5-da93-45a3-a01d-08c2db6ecb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:44.797802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 995/1982] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:44.802053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9519809-05e0-478d-9f42-00ddc4d41f6c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:44.811690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9519809-05e0-478d-9f42-00ddc4d41f6c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:44.816926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:44.817662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:44.817944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:44.818215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:44.818930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:44.819529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:44.821133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:44.833786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 988/1983] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:44.838099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7a2e5-da93-45a3-a01d-08c2db6ecb0b None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:44.847215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7a2e5-da93-45a3-a01d-08c2db6ecb0b None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:44.852428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3650-5c02-4669-82c4-33910013c197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:44.853067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3650-5c02-4669-82c4-33910013c197 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:44.853342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3650-5c02-4669-82c4-33910013c197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:44.853608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3650-5c02-4669-82c4-33910013c197 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:44.854293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee3650-5c02-4669-82c4-33910013c197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:44.856224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee3650-5c02-4669-82c4-33910013c197 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:44.881762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 996/1984] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:44 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:44.885937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:44.896471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365173f-e201-4a6c-abfb-dff71fe32a4c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:44.952290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e622a-9311-40ac-9026-5a2598372471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:44.952963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e622a-9311-40ac-9026-5a2598372471 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:44.953246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e622a-9311-40ac-9026-5a2598372471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:44.953522 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e622a-9311-40ac-9026-5a2598372471 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:44.954225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e622a-9311-40ac-9026-5a2598372471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:44.956178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e622a-9311-40ac-9026-5a2598372471 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:44.976500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 989/1985] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:44 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:44.980866 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3650-5c02-4669-82c4-33910013c197 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:44.992320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3650-5c02-4669-82c4-33910013c197 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:44.997137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eabd7-9f5a-42cc-8c1a-f5f91974cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:44.998000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eabd7-9f5a-42cc-8c1a-f5f91974cc29 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:44.998306 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eabd7-9f5a-42cc-8c1a-f5f91974cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:44.998573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eabd7-9f5a-42cc-8c1a-f5f91974cc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:44.999321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0eabd7-9f5a-42cc-8c1a-f5f91974cc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:45.001273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0eabd7-9f5a-42cc-8c1a-f5f91974cc29 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:45.012963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 997/1986] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:45.017067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e622a-9311-40ac-9026-5a2598372471 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:45.027560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e622a-9311-40ac-9026-5a2598372471 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:45.032138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9d3d8-dfbe-44fe-87f4-d0d346b39878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:45.032787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9d3d8-dfbe-44fe-87f4-d0d346b39878 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:45.033062 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9d3d8-dfbe-44fe-87f4-d0d346b39878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:45.033332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9d3d8-dfbe-44fe-87f4-d0d346b39878 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:45.034075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9d3d8-dfbe-44fe-87f4-d0d346b39878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:45.035729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9d3d8-dfbe-44fe-87f4-d0d346b39878 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:45.045420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 990/1987] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:45.049576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eabd7-9f5a-42cc-8c1a-f5f91974cc29 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:45.059694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eabd7-9f5a-42cc-8c1a-f5f91974cc29 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:45.065443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:45.067122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:45.067512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:45.067855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] PATH_INFO: `/v3/projects/65872cae60fe494cab25c35fcb307ae4/users/a4f43fc508604653b1c4babd2a713cc1/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:45.084175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65872cae60fe494cab25c35fcb307ae4, user_id=a4f43fc508604653b1c4babd2a713cc1, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:45.086880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:45.099103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 998/1988] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:45 2022] PUT /identity/v3/projects/65872cae60fe494cab25c35fcb307ae4/users/a4f43fc508604653b1c4babd2a713cc1/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:45.109059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea04ef-c85c-490c-a6fb-af69f06eb358 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:45.109345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea04ef-c85c-490c-a6fb-af69f06eb358 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:45.109646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea04ef-c85c-490c-a6fb-af69f06eb358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:45.135423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-20ea04ef-c85c-490c-a6fb-af69f06eb358 None None] MFA Rules not processed for user `a4f43fc508604653b1c4babd2a713cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:45.136635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-20ea04ef-c85c-490c-a6fb-af69f06eb358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:45.208691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 991/1989] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:45.219861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:45.222142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:45.305518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac5f4-6e05-412d-97b9-6718d8a610b1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:45.317683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000da9f-8a22-486f-98e0-c318dabed483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:45.318361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000da9f-8a22-486f-98e0-c318dabed483 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:45.318645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000da9f-8a22-486f-98e0-c318dabed483 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:45.318916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000da9f-8a22-486f-98e0-c318dabed483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:45.329114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000da9f-8a22-486f-98e0-c318dabed483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:45.330964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000da9f-8a22-486f-98e0-c318dabed483 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:45.342353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 999/1990] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:48.172678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea04ef-c85c-490c-a6fb-af69f06eb358 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:48.237672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea04ef-c85c-490c-a6fb-af69f06eb358 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:48.242372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:48.243256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:48.243566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:48.243843 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] PATH_INFO: `/v3/users/a4f43fc508604653b1c4babd2a713cc1` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:48.245039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f43fc508604653b1c4babd2a713cc1)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:48.246969 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:48.298832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f43fc508604653b1c4babd2a713cc1'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.306554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f43fc508604653b1c4babd2a713cc1'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.307318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f43fc508604653b1c4babd2a713cc1'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.315216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f43fc508604653b1c4babd2a713cc1'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.315929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f43fc508604653b1c4babd2a713cc1'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.334587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 992/1991] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:48 2022] DELETE /identity/v3/users/a4f43fc508604653b1c4babd2a713cc1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:48.339092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761c46-1413-4a3f-9d46-b5918abccec4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:48.339633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761c46-1413-4a3f-9d46-b5918abccec4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:48.339724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761c46-1413-4a3f-9d46-b5918abccec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:48.356803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3c761c46-1413-4a3f-9d46-b5918abccec4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:48.357998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3c761c46-1413-4a3f-9d46-b5918abccec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:48.415411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1000/1992] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:48.425070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:48.426983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:48.485021 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb081f4-d0a0-4862-978d-d7388c7bee8e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:48.489342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705fa40-0686-4ff4-a49f-fc3d6af575dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:48.489992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705fa40-0686-4ff4-a49f-fc3d6af575dd service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:48.490275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705fa40-0686-4ff4-a49f-fc3d6af575dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:48.490550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705fa40-0686-4ff4-a49f-fc3d6af575dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:48.499725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705fa40-0686-4ff4-a49f-fc3d6af575dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:48.501145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705fa40-0686-4ff4-a49f-fc3d6af575dd service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:48.511963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 993/1993] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:48.778532 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c761c46-1413-4a3f-9d46-b5918abccec4 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:48.780085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3c761c46-1413-4a3f-9d46-b5918abccec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:48.793489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c761c46-1413-4a3f-9d46-b5918abccec4 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:48.798074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:48.799165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:48.799482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:48.799755 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] PATH_INFO: `/v3/projects/65872cae60fe494cab25c35fcb307ae4` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:48.802134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65872cae60fe494cab25c35fcb307ae4)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:48.804140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:48.856471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65872cae60fe494cab25c35fcb307ae4', 'request_id': 'req-b2eb1880-7747-443f-b432-28f3cae32476'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.864740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65872cae60fe494cab25c35fcb307ae4', 'request_id': 'req-b2eb1880-7747-443f-b432-28f3cae32476'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.870536 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65872cae60fe494cab25c35fcb307ae4', 'request_id': 'req-b2eb1880-7747-443f-b432-28f3cae32476'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.881605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] The token cache is being invalidate because project 65872cae60fe494cab25c35fcb307ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:48.881891 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.882531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b2eb1880-7747-443f-b432-28f3cae32476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:48.884493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1001/1994] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:48 2022] DELETE /identity/v3/projects/65872cae60fe494cab25c35fcb307ae4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:48.889217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8b34-06e0-4216-b685-b62dfb4eb9a3 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:48.889576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8b34-06e0-4216-b685-b62dfb4eb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:48.890026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8b34-06e0-4216-b685-b62dfb4eb9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:48.911005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a02a8b34-06e0-4216-b685-b62dfb4eb9a3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:48.912633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a02a8b34-06e0-4216-b685-b62dfb4eb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:48.971815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 994/1995] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:48.981262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c987c-532d-40e6-82c0-64d09ae3169f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:48.981450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c987c-532d-40e6-82c0-64d09ae3169f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:48.981602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c987c-532d-40e6-82c0-64d09ae3169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.001283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3e8c987c-532d-40e6-82c0-64d09ae3169f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:49.002487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3e8c987c-532d-40e6-82c0-64d09ae3169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:49.010478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1002/1996] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:49.015633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a8b34-06e0-4216-b685-b62dfb4eb9a3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:49.025541 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a8b34-06e0-4216-b685-b62dfb4eb9a3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:49.030093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:49.030744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:49.031024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:49.031310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.032142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:49.032446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:49.034034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:49.045814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 995/1997] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:49.050152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c987c-532d-40e6-82c0-64d09ae3169f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:49.059881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c987c-532d-40e6-82c0-64d09ae3169f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:49.064527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a6d5-197a-47ba-a41e-91d78b1464b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:49.065172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a6d5-197a-47ba-a41e-91d78b1464b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:49.065455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a6d5-197a-47ba-a41e-91d78b1464b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:49.065730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a6d5-197a-47ba-a41e-91d78b1464b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.066475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a6d5-197a-47ba-a41e-91d78b1464b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:49.068419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a6d5-197a-47ba-a41e-91d78b1464b3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:49.092916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1003/1998] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:49 2022] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:49.097003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:49.107214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d86daa-46eb-4d52-9752-d64aad816aea admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:49.170131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a4d4e-a244-416f-91bb-6f7c955dc0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:49.171010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a4d4e-a244-416f-91bb-6f7c955dc0fe admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:49.171904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a4d4e-a244-416f-91bb-6f7c955dc0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:49.172193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a4d4e-a244-416f-91bb-6f7c955dc0fe admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.172895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a4d4e-a244-416f-91bb-6f7c955dc0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:49.174881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a4d4e-a244-416f-91bb-6f7c955dc0fe admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:49.211324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a6d5-197a-47ba-a41e-91d78b1464b3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:49.214388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 996/1999] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:49 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:49.229876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a6d5-197a-47ba-a41e-91d78b1464b3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:49.234853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb41f12-74b5-4dd6-9761-8f3ecc5fb1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:49.235589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41f12-74b5-4dd6-9761-8f3ecc5fb1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:49.236350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41f12-74b5-4dd6-9761-8f3ecc5fb1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:49.236350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41f12-74b5-4dd6-9761-8f3ecc5fb1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.236861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb41f12-74b5-4dd6-9761-8f3ecc5fb1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:49.238562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb41f12-74b5-4dd6-9761-8f3ecc5fb1a4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:49.250516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1004/2000] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:49.254822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a4d4e-a244-416f-91bb-6f7c955dc0fe admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:49.265179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a4d4e-a244-416f-91bb-6f7c955dc0fe admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:49.270520 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959196b-6b20-46ea-bc98-c430f99cba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:49.271192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959196b-6b20-46ea-bc98-c430f99cba27 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:49.271515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959196b-6b20-46ea-bc98-c430f99cba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:49.271797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959196b-6b20-46ea-bc98-c430f99cba27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.272526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959196b-6b20-46ea-bc98-c430f99cba27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:49.274115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959196b-6b20-46ea-bc98-c430f99cba27 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:49.286831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 997/2001] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:49.290526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb41f12-74b5-4dd6-9761-8f3ecc5fb1a4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:49.300484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb41f12-74b5-4dd6-9761-8f3ecc5fb1a4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:49.305308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:49.306176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:49.306452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:49.306721 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] PATH_INFO: `/v3/projects/ff0874b307c046a4a4e232dac4744091/users/4905818b9fab4013a800a5544784929b/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.322536 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0874b307c046a4a4e232dac4744091, user_id=4905818b9fab4013a800a5544784929b, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:49.325249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:49.338228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1005/2002] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:49 2022] PUT /identity/v3/projects/ff0874b307c046a4a4e232dac4744091/users/4905818b9fab4013a800a5544784929b/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:49.343493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe2217-e652-423a-80bb-6b17881255f4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:49.344027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe2217-e652-423a-80bb-6b17881255f4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:49.344304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe2217-e652-423a-80bb-6b17881255f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.361944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-babe2217-e652-423a-80bb-6b17881255f4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:49.363190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-babe2217-e652-423a-80bb-6b17881255f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:49.426561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 998/2003] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:49.436215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:49.437918 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:49.495535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad511-735a-4bf6-91fe-c2c7d0e5e305 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:49.499106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbaac5-3dc4-45e7-8a7f-addff582f935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:49.499829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbaac5-3dc4-45e7-8a7f-addff582f935 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:49.500058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbaac5-3dc4-45e7-8a7f-addff582f935 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:49.500333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbaac5-3dc4-45e7-8a7f-addff582f935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:49.514177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbaac5-3dc4-45e7-8a7f-addff582f935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:49.515655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbaac5-3dc4-45e7-8a7f-addff582f935 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:49.526156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1006/2004] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:58:50.126411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6902-2ded-433f-8a2a-67249f32fee7 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:50.126867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6902-2ded-433f-8a2a-67249f32fee7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:50.127445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6902-2ded-433f-8a2a-67249f32fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:50.158242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-353c6902-2ded-433f-8a2a-67249f32fee7 None None] MFA Rules not processed for user `4905818b9fab4013a800a5544784929b`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:50.159469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-353c6902-2ded-433f-8a2a-67249f32fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:50.238892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 999/2005] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:50.243442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbaac5-3dc4-45e7-8a7f-addff582f935 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:50.253057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbaac5-3dc4-45e7-8a7f-addff582f935 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:50.262986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4559f-9bcb-44c0-87fd-d6d51f096b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:50.263677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4559f-9bcb-44c0-87fd-d6d51f096b14 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:50.263955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4559f-9bcb-44c0-87fd-d6d51f096b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:50.264225 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4559f-9bcb-44c0-87fd-d6d51f096b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:50.264923 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4559f-9bcb-44c0-87fd-d6d51f096b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:50.267033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4559f-9bcb-44c0-87fd-d6d51f096b14 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:50.297276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1007/2006] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:50 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:50.301898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c6902-2ded-433f-8a2a-67249f32fee7 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:50.315336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c6902-2ded-433f-8a2a-67249f32fee7 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:50.373070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f144d8-a366-4266-9b20-b5e165f10cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:50.373741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f144d8-a366-4266-9b20-b5e165f10cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:50.374016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f144d8-a366-4266-9b20-b5e165f10cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:50.374291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f144d8-a366-4266-9b20-b5e165f10cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:50.374981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f144d8-a366-4266-9b20-b5e165f10cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:50.376931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f144d8-a366-4266-9b20-b5e165f10cb4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:50.401231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1000/2007] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:50 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:50.403749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4559f-9bcb-44c0-87fd-d6d51f096b14 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:50.414440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4559f-9bcb-44c0-87fd-d6d51f096b14 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:50.420015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9c63b-6f03-4b98-9c0b-531b5145fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:50.420806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c63b-6f03-4b98-9c0b-531b5145fdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:50.421503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c63b-6f03-4b98-9c0b-531b5145fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:50.421681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c63b-6f03-4b98-9c0b-531b5145fdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:50.422528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9c63b-6f03-4b98-9c0b-531b5145fdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:50.424245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9c63b-6f03-4b98-9c0b-531b5145fdb9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:50.438564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1008/2008] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:50.441560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f144d8-a366-4266-9b20-b5e165f10cb4 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:50.451936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f144d8-a366-4266-9b20-b5e165f10cb4 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:50.457984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb505775-162c-48d8-a93a-739a762f84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:50.458961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505775-162c-48d8-a93a-739a762f84f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:50.459249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505775-162c-48d8-a93a-739a762f84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:50.459574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505775-162c-48d8-a93a-739a762f84f7 admin admin] PATH_INFO: `/v3/projects/1dc951c4e2cc4d79b978b9f048e97200/users/42282f76707f4be0a2581e287d7b4402/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:50.480189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb505775-162c-48d8-a93a-739a762f84f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc951c4e2cc4d79b978b9f048e97200, user_id=42282f76707f4be0a2581e287d7b4402, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:50.482877 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb505775-162c-48d8-a93a-739a762f84f7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:50.496036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1001/2009] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:50 2022] PUT /identity/v3/projects/1dc951c4e2cc4d79b978b9f048e97200/users/42282f76707f4be0a2581e287d7b4402/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:50.500249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9c63b-6f03-4b98-9c0b-531b5145fdb9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:50.511196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9c63b-6f03-4b98-9c0b-531b5145fdb9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:50.600432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41389105-c737-4a74-8055-2760f891bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:50.601121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41389105-c737-4a74-8055-2760f891bd76 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:50.601407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41389105-c737-4a74-8055-2760f891bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:50.601685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41389105-c737-4a74-8055-2760f891bd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:50.602430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41389105-c737-4a74-8055-2760f891bd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:50.604086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41389105-c737-4a74-8055-2760f891bd76 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:50.615076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1009/2010] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:50.619202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb505775-162c-48d8-a93a-739a762f84f7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:50.630775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb505775-162c-48d8-a93a-739a762f84f7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:50.637322 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493c3c-2c3e-4261-a0e3-1c57f6b2f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:50.638261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493c3c-2c3e-4261-a0e3-1c57f6b2f63c admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:50.638620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493c3c-2c3e-4261-a0e3-1c57f6b2f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:50.638968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493c3c-2c3e-4261-a0e3-1c57f6b2f63c admin admin] PATH_INFO: `/v3/projects/1dc951c4e2cc4d79b978b9f048e97200/users/42282f76707f4be0a2581e287d7b4402/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:50.641119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a493c3c-2c3e-4261-a0e3-1c57f6b2f63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc951c4e2cc4d79b978b9f048e97200, user_id=42282f76707f4be0a2581e287d7b4402, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:50.644410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a493c3c-2c3e-4261-a0e3-1c57f6b2f63c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:50.659533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1002/2011] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:50 2022] PUT /identity/v3/projects/1dc951c4e2cc4d79b978b9f048e97200/users/42282f76707f4be0a2581e287d7b4402/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:51.392404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f734c-619a-410d-97ca-1c31debc62fb None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:51.392724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f734c-619a-410d-97ca-1c31debc62fb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:51.392961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f734c-619a-410d-97ca-1c31debc62fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:51.424500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-2b3f734c-619a-410d-97ca-1c31debc62fb None None] MFA Rules not processed for user `42282f76707f4be0a2581e287d7b4402`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:51.425925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2b3f734c-619a-410d-97ca-1c31debc62fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:51.499595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1010/2012] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:52.677654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493c3c-2c3e-4261-a0e3-1c57f6b2f63c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:52.758389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493c3c-2c3e-4261-a0e3-1c57f6b2f63c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:52.763288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:52.764321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:52.765396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:52.765396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] PATH_INFO: `/v3/users/4905818b9fab4013a800a5544784929b` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:52.766319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4905818b9fab4013a800a5544784929b)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:52.768321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:52.823440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4905818b9fab4013a800a5544784929b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:52.830629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4905818b9fab4013a800a5544784929b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:52.831403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4905818b9fab4013a800a5544784929b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:52.840677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4905818b9fab4013a800a5544784929b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:52.841488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4905818b9fab4013a800a5544784929b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:52.867411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1003/2013] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:52 2022] DELETE /identity/v3/users/4905818b9fab4013a800a5544784929b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:53.135075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f734c-619a-410d-97ca-1c31debc62fb None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:53.151198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f734c-619a-410d-97ca-1c31debc62fb None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:53.212620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:53.213525 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:53.213801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:53.214069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] PATH_INFO: `/v3/projects/ff0874b307c046a4a4e232dac4744091` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:53.215247 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0874b307c046a4a4e232dac4744091)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:53.217376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:53.262987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0874b307c046a4a4e232dac4744091', 'request_id': 'req-1ac5fece-df31-4f9b-8653-beb889833739'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.270646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0874b307c046a4a4e232dac4744091', 'request_id': 'req-1ac5fece-df31-4f9b-8653-beb889833739'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.276014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0874b307c046a4a4e232dac4744091', 'request_id': 'req-1ac5fece-df31-4f9b-8653-beb889833739'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.286595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] The token cache is being invalidate because project ff0874b307c046a4a4e232dac4744091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:53.286876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.287531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.289074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1011/2014] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:53 2022] DELETE /identity/v3/projects/ff0874b307c046a4a4e232dac4744091 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:53.293263 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:53.295218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:53.313059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990bea0-3abb-45cd-9f93-ddf1c29d01d4 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:53.368828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:53.369703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:53.370012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:53.370287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] PATH_INFO: `/v3/users/42282f76707f4be0a2581e287d7b4402` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:53.371501 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42282f76707f4be0a2581e287d7b4402)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:53.373413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:53.420345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42282f76707f4be0a2581e287d7b4402'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.426970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42282f76707f4be0a2581e287d7b4402'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.427652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42282f76707f4be0a2581e287d7b4402'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.434663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42282f76707f4be0a2581e287d7b4402'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.435289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b4c13845-3189-48a3-b29d-1a8ff85e8fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42282f76707f4be0a2581e287d7b4402'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.452560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1004/2015] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:58:53 2022] DELETE /identity/v3/users/42282f76707f4be0a2581e287d7b4402 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:53.650337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:53.652883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:53.669393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5fece-df31-4f9b-8653-beb889833739 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:53.744853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:53.747853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:53.748626 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:53.749566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] PATH_INFO: `/v3/projects/1dc951c4e2cc4d79b978b9f048e97200` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:53.751983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc951c4e2cc4d79b978b9f048e97200)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:53.756596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:53.806695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc951c4e2cc4d79b978b9f048e97200', 'request_id': 'req-b6e453c8-0ba5-4f98-8616-916095986bb8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.813909 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc951c4e2cc4d79b978b9f048e97200', 'request_id': 'req-b6e453c8-0ba5-4f98-8616-916095986bb8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.820109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc951c4e2cc4d79b978b9f048e97200', 'request_id': 'req-b6e453c8-0ba5-4f98-8616-916095986bb8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.830905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] The token cache is being invalidate because project 1dc951c4e2cc4d79b978b9f048e97200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:58:53.831189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.831872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b6e453c8-0ba5-4f98-8616-916095986bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:58:53.833485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1012/2016] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:58:53 2022] DELETE /identity/v3/projects/1dc951c4e2cc4d79b978b9f048e97200 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:53.838624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338168d-e983-4659-8cc9-9feb71f36c2e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:53.839163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338168d-e983-4659-8cc9-9feb71f36c2e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:53.839163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338168d-e983-4659-8cc9-9feb71f36c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:53.856363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b338168d-e983-4659-8cc9-9feb71f36c2e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:53.857556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b338168d-e983-4659-8cc9-9feb71f36c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:53.915877 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1005/2017] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:58:53.923608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76946643-9b12-43ce-8070-73cc5e20e3d3 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:53.923818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76946643-9b12-43ce-8070-73cc5e20e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:53.924095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76946643-9b12-43ce-8070-73cc5e20e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:53.946576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-76946643-9b12-43ce-8070-73cc5e20e3d3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:53.947847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-76946643-9b12-43ce-8070-73cc5e20e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:53.956313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1013/2018] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:53.960484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338168d-e983-4659-8cc9-9feb71f36c2e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:53.970122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338168d-e983-4659-8cc9-9feb71f36c2e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:53.974764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:53.975518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:53.975841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:53.976160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:53.976947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:58:53.977428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:53.979383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:53.992265 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1006/2019] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:58:53.996576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76946643-9b12-43ce-8070-73cc5e20e3d3 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.006417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76946643-9b12-43ce-8070-73cc5e20e3d3 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.011504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feda2c-e703-48a1-a7ea-70f6adb6e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.012438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feda2c-e703-48a1-a7ea-70f6adb6e29f admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.013183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feda2c-e703-48a1-a7ea-70f6adb6e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.013183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feda2c-e703-48a1-a7ea-70f6adb6e29f admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.013833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feda2c-e703-48a1-a7ea-70f6adb6e29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.015839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feda2c-e703-48a1-a7ea-70f6adb6e29f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.043491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1014/2020] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:53 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:54.048219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.058804 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48e76-af4a-4319-a248-f71f9c4c0de1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.132761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e0ddf-9bbb-49cb-92f8-71ff1da8763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.133444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e0ddf-9bbb-49cb-92f8-71ff1da8763d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.133723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e0ddf-9bbb-49cb-92f8-71ff1da8763d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.133998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e0ddf-9bbb-49cb-92f8-71ff1da8763d admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.134691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e0ddf-9bbb-49cb-92f8-71ff1da8763d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.136654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e0ddf-9bbb-49cb-92f8-71ff1da8763d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.157223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1007/2021] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:54 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:58:54.161786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feda2c-e703-48a1-a7ea-70f6adb6e29f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.172086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feda2c-e703-48a1-a7ea-70f6adb6e29f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.180523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dfc78-4fdc-4f4a-933e-a46146beeb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.181171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dfc78-4fdc-4f4a-933e-a46146beeb9b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.181519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dfc78-4fdc-4f4a-933e-a46146beeb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.181859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dfc78-4fdc-4f4a-933e-a46146beeb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.182663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525dfc78-4fdc-4f4a-933e-a46146beeb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.184467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525dfc78-4fdc-4f4a-933e-a46146beeb9b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.199060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1015/2022] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:54.200257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e0ddf-9bbb-49cb-92f8-71ff1da8763d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.212802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e0ddf-9bbb-49cb-92f8-71ff1da8763d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.217696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b557-c9b6-4c35-9b2a-70d4f05cb791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.218401 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b557-c9b6-4c35-9b2a-70d4f05cb791 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.218825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b557-c9b6-4c35-9b2a-70d4f05cb791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.219101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b557-c9b6-4c35-9b2a-70d4f05cb791 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.219862 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94b557-c9b6-4c35-9b2a-70d4f05cb791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.221464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94b557-c9b6-4c35-9b2a-70d4f05cb791 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.233455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1008/2023] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:58:54.237516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dfc78-4fdc-4f4a-933e-a46146beeb9b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.248230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dfc78-4fdc-4f4a-933e-a46146beeb9b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.252863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83aacb-26cb-43c9-9fa1-04a49fc39196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.253774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83aacb-26cb-43c9-9fa1-04a49fc39196 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.254053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83aacb-26cb-43c9-9fa1-04a49fc39196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.254325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83aacb-26cb-43c9-9fa1-04a49fc39196 admin admin] PATH_INFO: `/v3/projects/b2edb585df8f449392528b46efbba148/users/f5f00857451442969d3e9c54e17bef37/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.268605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83aacb-26cb-43c9-9fa1-04a49fc39196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2edb585df8f449392528b46efbba148, user_id=f5f00857451442969d3e9c54e17bef37, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.271331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83aacb-26cb-43c9-9fa1-04a49fc39196 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.287363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1016/2024] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:54 2022] PUT /identity/v3/projects/b2edb585df8f449392528b46efbba148/users/f5f00857451442969d3e9c54e17bef37/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:54.297731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592260a7-1cbf-44a5-a285-4b11fda4c69c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.298029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592260a7-1cbf-44a5-a285-4b11fda4c69c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.298313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592260a7-1cbf-44a5-a285-4b11fda4c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.326317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-592260a7-1cbf-44a5-a285-4b11fda4c69c None None] MFA Rules not processed for user `f5f00857451442969d3e9c54e17bef37`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:54.327580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-592260a7-1cbf-44a5-a285-4b11fda4c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:54.390777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1009/2025] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:54.396041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83aacb-26cb-43c9-9fa1-04a49fc39196 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.461955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83aacb-26cb-43c9-9fa1-04a49fc39196 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.466561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b312d12-ee58-41da-8cd5-5a8654f73455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.467223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b312d12-ee58-41da-8cd5-5a8654f73455 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.467538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b312d12-ee58-41da-8cd5-5a8654f73455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.467814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b312d12-ee58-41da-8cd5-5a8654f73455 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.468530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b312d12-ee58-41da-8cd5-5a8654f73455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.470461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b312d12-ee58-41da-8cd5-5a8654f73455 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.498800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1017/2026] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:58:54 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:54.500016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592260a7-1cbf-44a5-a285-4b11fda4c69c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.510666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592260a7-1cbf-44a5-a285-4b11fda4c69c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.566650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f500-d675-4315-a9d0-a74293184c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.567407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f500-d675-4315-a9d0-a74293184c9c admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.567696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f500-d675-4315-a9d0-a74293184c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.567967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f500-d675-4315-a9d0-a74293184c9c admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.568658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0f500-d675-4315-a9d0-a74293184c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.570822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0f500-d675-4315-a9d0-a74293184c9c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.593362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1010/2027] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:58:54 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:58:54.594977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b312d12-ee58-41da-8cd5-5a8654f73455 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.606273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b312d12-ee58-41da-8cd5-5a8654f73455 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.611360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc792af-3337-49ad-a5d7-5e21ff1494df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.612152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc792af-3337-49ad-a5d7-5e21ff1494df admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.612513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc792af-3337-49ad-a5d7-5e21ff1494df admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.612864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc792af-3337-49ad-a5d7-5e21ff1494df admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.613707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc792af-3337-49ad-a5d7-5e21ff1494df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.615436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc792af-3337-49ad-a5d7-5e21ff1494df admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.626845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1018/2028] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:54.631247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f500-d675-4315-a9d0-a74293184c9c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.641185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f500-d675-4315-a9d0-a74293184c9c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.647231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbb58-5635-43a7-8079-95d61c2722ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.648222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbb58-5635-43a7-8079-95d61c2722ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.648535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbb58-5635-43a7-8079-95d61c2722ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.648810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbb58-5635-43a7-8079-95d61c2722ef admin admin] PATH_INFO: `/v3/projects/114820553e574c61bbebc02fec21dc65/users/da39cbd6c42c4b6f88c47005ce28334c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.664940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cbb58-5635-43a7-8079-95d61c2722ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=114820553e574c61bbebc02fec21dc65, user_id=da39cbd6c42c4b6f88c47005ce28334c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.667629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cbb58-5635-43a7-8079-95d61c2722ef admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.681189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1011/2029] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:54 2022] PUT /identity/v3/projects/114820553e574c61bbebc02fec21dc65/users/da39cbd6c42c4b6f88c47005ce28334c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:58:54.685142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc792af-3337-49ad-a5d7-5e21ff1494df admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.695582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc792af-3337-49ad-a5d7-5e21ff1494df admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.750296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da2e1e-9170-4605-b224-afe05879d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.750884 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da2e1e-9170-4605-b224-afe05879d6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.751173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da2e1e-9170-4605-b224-afe05879d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.751490 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da2e1e-9170-4605-b224-afe05879d6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.752210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da2e1e-9170-4605-b224-afe05879d6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.754327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da2e1e-9170-4605-b224-afe05879d6c0 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.763833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1019/2030] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:58:54.768668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbb58-5635-43a7-8079-95d61c2722ef admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.779657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbb58-5635-43a7-8079-95d61c2722ef admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:54.784636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:54.785798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.786099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.786373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] PATH_INFO: `/v3/projects/114820553e574c61bbebc02fec21dc65/users/da39cbd6c42c4b6f88c47005ce28334c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.788623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] RBAC: Authorizing `identity:create_grant(project_id=114820553e574c61bbebc02fec21dc65, user_id=da39cbd6c42c4b6f88c47005ce28334c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:54.791392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:54.802568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1012/2031] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:58:54 2022] PUT /identity/v3/projects/114820553e574c61bbebc02fec21dc65/users/da39cbd6c42c4b6f88c47005ce28334c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:58:54.814161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad483f-63ef-423d-a7e3-714403313720 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:54.814452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad483f-63ef-423d-a7e3-714403313720 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:54.814730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad483f-63ef-423d-a7e3-714403313720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:54.841958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-72ad483f-63ef-423d-a7e3-714403313720 None None] MFA Rules not processed for user `da39cbd6c42c4b6f88c47005ce28334c`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:58:54.843442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-72ad483f-63ef-423d-a7e3-714403313720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:54.926348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1020/2032] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:58:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:58:54.942060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:54.946020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:58:55.005947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396893f9-facf-4ff3-abbe-fb9f9cec886f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:55.009545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cedb54-428e-4189-9e3d-022252505bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:55.010194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cedb54-428e-4189-9e3d-022252505bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:55.010477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cedb54-428e-4189-9e3d-022252505bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:55.010750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cedb54-428e-4189-9e3d-022252505bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:55.020234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cedb54-428e-4189-9e3d-022252505bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:55.021657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cedb54-428e-4189-9e3d-022252505bf4 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:55.031650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1013/2033] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:58:55.116355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad483f-63ef-423d-a7e3-714403313720 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:58:55.128309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad483f-63ef-423d-a7e3-714403313720 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:58:55.133472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:58:55.134235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:58:55.134597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:58:55.135585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:58:55.219329 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:58:55.220818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:58:55.231853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1021/2034] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:58:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:06.972710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c2763-2be3-4143-8b89-bdaba9a76c8e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:06.973204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c2763-2be3-4143-8b89-bdaba9a76c8e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:06.973313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c2763-2be3-4143-8b89-bdaba9a76c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:06.991040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-097c2763-2be3-4143-8b89-bdaba9a76c8e None None] MFA Rules not processed for user `04109028620d4b7284fbd32efc695c56`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:06.992335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-097c2763-2be3-4143-8b89-bdaba9a76c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:07.045433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1014/2035] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:09.128400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:09.129924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:09.218065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade24d-d5fb-4431-be60-4df1fa6b2072 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:09.224825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:09.226226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:09.226739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:09.227271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] PATH_INFO: `/v3/users/9be267cc6c3b48c79560ceedf8ca9d88` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:09.229160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be267cc6c3b48c79560ceedf8ca9d88)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:09.231672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:09.311886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be267cc6c3b48c79560ceedf8ca9d88'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:09.320791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be267cc6c3b48c79560ceedf8ca9d88'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:09.331852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be267cc6c3b48c79560ceedf8ca9d88'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:09.332814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be267cc6c3b48c79560ceedf8ca9d88'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:09.353302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a9af524a-b7e9-4235-acc5-923b2b3abac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be267cc6c3b48c79560ceedf8ca9d88'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:09.360136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1022/2036] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:09 2022] DELETE /identity/v3/users/9be267cc6c3b48c79560ceedf8ca9d88 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:59:09.365196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a015-357e-4df9-9b68-10199962057b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:09.366258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a015-357e-4df9-9b68-10199962057b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:09.366727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a015-357e-4df9-9b68-10199962057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:09.391758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-5bc4a015-357e-4df9-9b68-10199962057b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:09.394133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5bc4a015-357e-4df9-9b68-10199962057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:09.496893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744d4d8-63e0-4849-b081-a0950228cf71 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:09.497310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744d4d8-63e0-4849-b081-a0950228cf71 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:09.498113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744d4d8-63e0-4849-b081-a0950228cf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:09.509919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1015/2037] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:09.521898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4a015-357e-4df9-9b68-10199962057b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:09.523647 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5bc4a015-357e-4df9-9b68-10199962057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:09.540210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-4744d4d8-63e0-4849-b081-a0950228cf71 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:09.542184 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4744d4d8-63e0-4849-b081-a0950228cf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:09.600431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4a015-357e-4df9-9b68-10199962057b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:09.604742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:09.605411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:09.605894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:09.606321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:09.616854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:09.618742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:09.621432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1023/2038] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:59:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:09.649382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1016/2039] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:09.678585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744d4d8-63e0-4849-b081-a0950228cf71 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:09.680597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4744d4d8-63e0-4849-b081-a0950228cf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:09.778636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744d4d8-63e0-4849-b081-a0950228cf71 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:09.784029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad121a14-4dce-4add-b4b8-fec84f4299c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:09.785041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121a14-4dce-4add-b4b8-fec84f4299c8 service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:09.785571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121a14-4dce-4add-b4b8-fec84f4299c8 service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:09.786000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad121a14-4dce-4add-b4b8-fec84f4299c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:09.797318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121a14-4dce-4add-b4b8-fec84f4299c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:09.799276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad121a14-4dce-4add-b4b8-fec84f4299c8 service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:09.808664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1024/2040] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 18:59:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 18:59:10.271849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:10.275215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:10.292886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1b63-288e-41bc-88dd-34e0c536b609 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:10.298303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:10.299598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.300039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.300450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] PATH_INFO: `/v3/projects/64c98e7aaaee4a9c94b67b1d908e367c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.301883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c98e7aaaee4a9c94b67b1d908e367c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:10.304643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:10.360758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c98e7aaaee4a9c94b67b1d908e367c', 'request_id': 'req-7ac6b8fb-3413-498b-bf17-126843c333a3'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:10.366758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c98e7aaaee4a9c94b67b1d908e367c', 'request_id': 'req-7ac6b8fb-3413-498b-bf17-126843c333a3'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:10.376408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c98e7aaaee4a9c94b67b1d908e367c', 'request_id': 'req-7ac6b8fb-3413-498b-bf17-126843c333a3'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:10.388486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] The token cache is being invalidate because project 64c98e7aaaee4a9c94b67b1d908e367c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:10.388986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:10.389772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ac6b8fb-3413-498b-bf17-126843c333a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:10.396637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1017/2041] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:10 2022] DELETE /identity/v3/projects/64c98e7aaaee4a9c94b67b1d908e367c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:10.401140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d3b7-e8b0-4fdc-bf79-b065361aa5f3 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.401569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d3b7-e8b0-4fdc-bf79-b065361aa5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.401679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d3b7-e8b0-4fdc-bf79-b065361aa5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.426884 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8ce5d3b7-e8b0-4fdc-bf79-b065361aa5f3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:10.428944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8ce5d3b7-e8b0-4fdc-bf79-b065361aa5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:10.525891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d6ed-2828-437a-801c-cc2256887747 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.526177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d6ed-2828-437a-801c-cc2256887747 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.526457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d6ed-2828-437a-801c-cc2256887747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.530462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1025/2042] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:10.548853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-08e2d6ed-2828-437a-801c-cc2256887747 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:10.550384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-08e2d6ed-2828-437a-801c-cc2256887747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:10.563455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1018/2043] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:10.568558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d3b7-e8b0-4fdc-bf79-b065361aa5f3 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:10.579780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d3b7-e8b0-4fdc-bf79-b065361aa5f3 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:10.586122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:10.587044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.587521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.588186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.589076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:59:10.589530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:10.591549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:10.605038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07965e-3737-4a0d-b515-0569b067c3b0 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.606112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07965e-3737-4a0d-b515-0569b067c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.606547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07965e-3737-4a0d-b515-0569b067c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.626454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1026/2044] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:59:10.632758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:10.645257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-5f07965e-3737-4a0d-b515-0569b067c3b0 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:10.647191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5f07965e-3737-4a0d-b515-0569b067c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:10.659003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b274d-b24d-4b00-a6a8-4ba8b062abc9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:10.671026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b70a76-4f70-42f9-bf47-1a80dbb47f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:10.671716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b70a76-4f70-42f9-bf47-1a80dbb47f22 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.671999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b70a76-4f70-42f9-bf47-1a80dbb47f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.672272 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b70a76-4f70-42f9-bf47-1a80dbb47f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.672960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b70a76-4f70-42f9-bf47-1a80dbb47f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:10.674870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b70a76-4f70-42f9-bf47-1a80dbb47f22 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:10.722299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1027/2045] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:10 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:10.727002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b70a76-4f70-42f9-bf47-1a80dbb47f22 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:10.748088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1019/2046] 10.222.0.93 () {58 vars in 967 bytes} [Wed May 11 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:10.763436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07965e-3737-4a0d-b515-0569b067c3b0 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:10.766203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5f07965e-3737-4a0d-b515-0569b067c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:10.835799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b70a76-4f70-42f9-bf47-1a80dbb47f22 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:10.842585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873697-315e-4d77-898c-067c2441ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:10.843636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873697-315e-4d77-898c-067c2441ca77 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.844219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873697-315e-4d77-898c-067c2441ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.845314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873697-315e-4d77-898c-067c2441ca77 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.846311 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db873697-315e-4d77-898c-067c2441ca77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:10.848709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db873697-315e-4d77-898c-067c2441ca77 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:10.874330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1028/2047] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:10 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:10.878257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873697-315e-4d77-898c-067c2441ca77 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:10.887255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07965e-3737-4a0d-b515-0569b067c3b0 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:10.891278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873697-315e-4d77-898c-067c2441ca77 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:10.898401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8389d62-7a9f-4ad7-9f92-83772b3a24da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:10.899786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8389d62-7a9f-4ad7-9f92-83772b3a24da admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.900278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8389d62-7a9f-4ad7-9f92-83772b3a24da admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.900905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8389d62-7a9f-4ad7-9f92-83772b3a24da admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.902166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8389d62-7a9f-4ad7-9f92-83772b3a24da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:10.904059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8389d62-7a9f-4ad7-9f92-83772b3a24da admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:10.918632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1029/2048] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:10.922704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8389d62-7a9f-4ad7-9f92-83772b3a24da admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:10.943504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8389d62-7a9f-4ad7-9f92-83772b3a24da admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:10.960266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2c5de-c3a3-4f5a-a651-86ae89429182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:10.960934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2c5de-c3a3-4f5a-a651-86ae89429182 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.961211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2c5de-c3a3-4f5a-a651-86ae89429182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.961479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2c5de-c3a3-4f5a-a651-86ae89429182 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:10.962293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2c5de-c3a3-4f5a-a651-86ae89429182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:10.963847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2c5de-c3a3-4f5a-a651-86ae89429182 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:10.984276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1030/2049] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:10.989934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2c5de-c3a3-4f5a-a651-86ae89429182 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:10.990755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8beb92-5e92-42d5-92f8-e56734305f8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:10.991445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8beb92-5e92-42d5-92f8-e56734305f8b service swift] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:10.991719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8beb92-5e92-42d5-92f8-e56734305f8b service swift] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:10.991982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8beb92-5e92-42d5-92f8-e56734305f8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.016027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2c5de-c3a3-4f5a-a651-86ae89429182 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.026657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78590747-184c-4c38-8577-4f0014e1cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.027800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590747-184c-4c38-8577-4f0014e1cccb admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.028169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590747-184c-4c38-8577-4f0014e1cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.028449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590747-184c-4c38-8577-4f0014e1cccb admin admin] PATH_INFO: `/v3/projects/7f10e4faa19f42ada6e96504c417e1f6/users/888f18f9fa5b4dfabae1d48cba5f9ce7/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.050592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78590747-184c-4c38-8577-4f0014e1cccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f10e4faa19f42ada6e96504c417e1f6, user_id=888f18f9fa5b4dfabae1d48cba5f9ce7, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.054773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78590747-184c-4c38-8577-4f0014e1cccb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.082943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1031/2050] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:10 2022] PUT /identity/v3/projects/7f10e4faa19f42ada6e96504c417e1f6/users/888f18f9fa5b4dfabae1d48cba5f9ce7/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:11.094553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ac987-2eb0-44ff-9ab3-3b3e8c1dc16e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.095377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ac987-2eb0-44ff-9ab3-3b3e8c1dc16e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.095377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ac987-2eb0-44ff-9ab3-3b3e8c1dc16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.121855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8beb92-5e92-42d5-92f8-e56734305f8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.125181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8beb92-5e92-42d5-92f8-e56734305f8b service swift] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.143375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1020/2051] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 18:59:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 18:59:11.146914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-136ac987-2eb0-44ff-9ab3-3b3e8c1dc16e None None] MFA Rules not processed for user `888f18f9fa5b4dfabae1d48cba5f9ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:11.148165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-136ac987-2eb0-44ff-9ab3-3b3e8c1dc16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:11.257337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1032/2052] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:11.261416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8beb92-5e92-42d5-92f8-e56734305f8b service swift] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:11.272422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8beb92-5e92-42d5-92f8-e56734305f8b service swift] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.344243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b2710-a5cd-406a-b984-24d2b570ba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.345517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b2710-a5cd-406a-b984-24d2b570ba68 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.346031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b2710-a5cd-406a-b984-24d2b570ba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.347078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b2710-a5cd-406a-b984-24d2b570ba68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.349409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b2710-a5cd-406a-b984-24d2b570ba68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.352361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b2710-a5cd-406a-b984-24d2b570ba68 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.386186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1021/2053] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:11 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:11.390310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ac987-2eb0-44ff-9ab3-3b3e8c1dc16e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:11.404978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ac987-2eb0-44ff-9ab3-3b3e8c1dc16e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.450373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f9ff-d86d-4eae-94ad-b8bde17656b2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.451686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f9ff-d86d-4eae-94ad-b8bde17656b2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.452053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f9ff-d86d-4eae-94ad-b8bde17656b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.473177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26463e24-dbcc-494b-be8e-4e17d3b9f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.474074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26463e24-dbcc-494b-be8e-4e17d3b9f982 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.474350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26463e24-dbcc-494b-be8e-4e17d3b9f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.474614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26463e24-dbcc-494b-be8e-4e17d3b9f982 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.475346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26463e24-dbcc-494b-be8e-4e17d3b9f982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.477471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26463e24-dbcc-494b-be8e-4e17d3b9f982 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.480193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7c30f9ff-d86d-4eae-94ad-b8bde17656b2 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:11.481463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7c30f9ff-d86d-4eae-94ad-b8bde17656b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:11.500773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1033/2054] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:11 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:11.504663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26463e24-dbcc-494b-be8e-4e17d3b9f982 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:11.521240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26463e24-dbcc-494b-be8e-4e17d3b9f982 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.526882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b24218-b2ec-4a01-8589-f4ee65ee2247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.527597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24218-b2ec-4a01-8589-f4ee65ee2247 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.527871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24218-b2ec-4a01-8589-f4ee65ee2247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.528159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24218-b2ec-4a01-8589-f4ee65ee2247 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.529015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b24218-b2ec-4a01-8589-f4ee65ee2247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.530524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b24218-b2ec-4a01-8589-f4ee65ee2247 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.544788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1034/2055] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:11.546716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b24218-b2ec-4a01-8589-f4ee65ee2247 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:11.554084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1022/2056] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:11.558631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b24218-b2ec-4a01-8589-f4ee65ee2247 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.563548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0d658-4b3a-4395-b2da-d07ba3e1558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.564199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d658-4b3a-4395-b2da-d07ba3e1558c admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.564478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d658-4b3a-4395-b2da-d07ba3e1558c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.564765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d658-4b3a-4395-b2da-d07ba3e1558c admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.565607 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0d658-4b3a-4395-b2da-d07ba3e1558c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.567455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0d658-4b3a-4395-b2da-d07ba3e1558c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.568621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f9ff-d86d-4eae-94ad-b8bde17656b2 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:11.584584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1035/2057] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:11.588399 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0d658-4b3a-4395-b2da-d07ba3e1558c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:11.599073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0d658-4b3a-4395-b2da-d07ba3e1558c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.604032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511eda8-a25a-401f-a892-331c1f4f826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.605005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511eda8-a25a-401f-a892-331c1f4f826d admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.605291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511eda8-a25a-401f-a892-331c1f4f826d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.605567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511eda8-a25a-401f-a892-331c1f4f826d admin admin] PATH_INFO: `/v3/projects/af1291d04c4c4b96bf6f76ccfaf2cf2c/users/d32c15c5010c4ff4ae39d8a2715a38a4/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.625256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511eda8-a25a-401f-a892-331c1f4f826d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1291d04c4c4b96bf6f76ccfaf2cf2c, user_id=d32c15c5010c4ff4ae39d8a2715a38a4, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.628705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511eda8-a25a-401f-a892-331c1f4f826d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.643084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f9ff-d86d-4eae-94ad-b8bde17656b2 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.643644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1036/2058] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:11 2022] PUT /identity/v3/projects/af1291d04c4c4b96bf6f76ccfaf2cf2c/users/d32c15c5010c4ff4ae39d8a2715a38a4/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:59:11.655524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1251-6f4b-42f9-9d02-fbac04ed6e38 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.655824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1251-6f4b-42f9-9d02-fbac04ed6e38 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.656086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1251-6f4b-42f9-9d02-fbac04ed6e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.686282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-112d1251-6f4b-42f9-9d02-fbac04ed6e38 None None] MFA Rules not processed for user `d32c15c5010c4ff4ae39d8a2715a38a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:11.687614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-112d1251-6f4b-42f9-9d02-fbac04ed6e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:11.722686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9edbd-97d4-4135-a7b4-8c04bbeb0507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.724208 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9edbd-97d4-4135-a7b4-8c04bbeb0507 service swift] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.724522 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9edbd-97d4-4135-a7b4-8c04bbeb0507 service swift] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.724757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9edbd-97d4-4135-a7b4-8c04bbeb0507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.761107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1037/2059] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:11.766213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d1251-6f4b-42f9-9d02-fbac04ed6e38 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:11.788634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9edbd-97d4-4135-a7b4-8c04bbeb0507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.790260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9edbd-97d4-4135-a7b4-8c04bbeb0507 service swift] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.801948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1023/2060] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 18:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 18:59:11.837615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d1251-6f4b-42f9-9d02-fbac04ed6e38 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.845730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5c018-f89f-4b98-bb63-b917f8d0b276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.846458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5c018-f89f-4b98-bb63-b917f8d0b276 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.846732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5c018-f89f-4b98-bb63-b917f8d0b276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.847004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5c018-f89f-4b98-bb63-b917f8d0b276 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.847906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5c018-f89f-4b98-bb63-b917f8d0b276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.850550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5c018-f89f-4b98-bb63-b917f8d0b276 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.879433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1038/2061] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:11 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:11.882291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9edbd-97d4-4135-a7b4-8c04bbeb0507 service swift] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:11.893571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9edbd-97d4-4135-a7b4-8c04bbeb0507 service swift] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:11.960034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4938a-dc40-4bb4-8e64-dc38b861968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:11.960742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4938a-dc40-4bb4-8e64-dc38b861968a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:11.961025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4938a-dc40-4bb4-8e64-dc38b861968a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:11.961300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4938a-dc40-4bb4-8e64-dc38b861968a admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:11.961995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4938a-dc40-4bb4-8e64-dc38b861968a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:11.963960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4938a-dc40-4bb4-8e64-dc38b861968a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:11.986782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1024/2062] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:11 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:11.990845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5c018-f89f-4b98-bb63-b917f8d0b276 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:12.002990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5c018-f89f-4b98-bb63-b917f8d0b276 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:12.009364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bd04d-c512-4a29-9207-633357315431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:12.010035 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bd04d-c512-4a29-9207-633357315431 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:12.010319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bd04d-c512-4a29-9207-633357315431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:12.010588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bd04d-c512-4a29-9207-633357315431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:12.011337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bd04d-c512-4a29-9207-633357315431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:12.012946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bd04d-c512-4a29-9207-633357315431 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:12.024511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1039/2063] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:12.029145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4938a-dc40-4bb4-8e64-dc38b861968a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:12.040573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4938a-dc40-4bb4-8e64-dc38b861968a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:12.045164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27de341-f406-4900-bee8-21b38df78a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:12.046055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27de341-f406-4900-bee8-21b38df78a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:12.046330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27de341-f406-4900-bee8-21b38df78a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:12.046591 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27de341-f406-4900-bee8-21b38df78a9f admin admin] PATH_INFO: `/v3/projects/462a938b94a2412487de16c3281e1f52/users/f9e07a73a1ea423ca3a942be405de2bb/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:12.063605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27de341-f406-4900-bee8-21b38df78a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=462a938b94a2412487de16c3281e1f52, user_id=f9e07a73a1ea423ca3a942be405de2bb, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:12.066144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27de341-f406-4900-bee8-21b38df78a9f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:12.080343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1025/2064] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:12 2022] PUT /identity/v3/projects/462a938b94a2412487de16c3281e1f52/users/f9e07a73a1ea423ca3a942be405de2bb/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:59:12.084652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bd04d-c512-4a29-9207-633357315431 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:12.096727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bd04d-c512-4a29-9207-633357315431 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:12.155006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb997cd-2692-4375-96f9-6747c025d789 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:12.155640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb997cd-2692-4375-96f9-6747c025d789 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:12.156267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb997cd-2692-4375-96f9-6747c025d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:12.175509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-0fb997cd-2692-4375-96f9-6747c025d789 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:12.176715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0fb997cd-2692-4375-96f9-6747c025d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:12.189679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45179195-5ca0-489c-b29c-f15efdb1e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:12.190675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179195-5ca0-489c-b29c-f15efdb1e788 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:12.190956 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179195-5ca0-489c-b29c-f15efdb1e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:12.191232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179195-5ca0-489c-b29c-f15efdb1e788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:12.192516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179195-5ca0-489c-b29c-f15efdb1e788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:12.194942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179195-5ca0-489c-b29c-f15efdb1e788 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:12.209656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1040/2065] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:12.211394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45179195-5ca0-489c-b29c-f15efdb1e788 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:12.221242 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45179195-5ca0-489c-b29c-f15efdb1e788 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:12.226371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49d64c-ceeb-4b46-b451-75f825266054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:12.227265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d64c-ceeb-4b46-b451-75f825266054 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:12.227574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d64c-ceeb-4b46-b451-75f825266054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:12.227842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d64c-ceeb-4b46-b451-75f825266054 admin admin] PATH_INFO: `/v3/projects/462a938b94a2412487de16c3281e1f52/users/f9e07a73a1ea423ca3a942be405de2bb/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:12.229872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49d64c-ceeb-4b46-b451-75f825266054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462a938b94a2412487de16c3281e1f52, user_id=f9e07a73a1ea423ca3a942be405de2bb, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:12.232561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49d64c-ceeb-4b46-b451-75f825266054 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:12.248332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1041/2066] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:12 2022] PUT /identity/v3/projects/462a938b94a2412487de16c3281e1f52/users/f9e07a73a1ea423ca3a942be405de2bb/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:12.260169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274c2d-5d7a-44d8-806c-169243273a92 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:12.260321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274c2d-5d7a-44d8-806c-169243273a92 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:12.260709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f274c2d-5d7a-44d8-806c-169243273a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:12.271266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1026/2067] 10.222.0.93 () {58 vars in 967 bytes} [Wed May 11 18:59:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:12.284367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb997cd-2692-4375-96f9-6747c025d789 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:12.295017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-1f274c2d-5d7a-44d8-806c-169243273a92 None None] MFA Rules not processed for user `f9e07a73a1ea423ca3a942be405de2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:12.296198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1f274c2d-5d7a-44d8-806c-169243273a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:12.373531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb997cd-2692-4375-96f9-6747c025d789 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:12.389507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1042/2068] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:12.401878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f274c2d-5d7a-44d8-806c-169243273a92 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:12.403394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1f274c2d-5d7a-44d8-806c-169243273a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:12.440594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:12.441245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:12.442255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:12.442532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:12.463448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f274c2d-5d7a-44d8-806c-169243273a92 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:12.467258 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:12.467929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:12.468205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:12.468472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:12.498554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:12.500250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:12.509462 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1027/2069] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 18:59:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 18:59:12.528129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:12.529678 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:12.543355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1043/2070] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:59:14.053921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:14.055420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:14.067103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9776ee-344b-4ee2-b299-a044f6aaf77a service swift] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:14.070820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f1965-67cd-4cb8-b526-659588f11c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:14.071498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f1965-67cd-4cb8-b526-659588f11c65 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:14.071777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f1965-67cd-4cb8-b526-659588f11c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:14.072050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f1965-67cd-4cb8-b526-659588f11c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:14.126034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f1965-67cd-4cb8-b526-659588f11c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:14.127423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f1965-67cd-4cb8-b526-659588f11c65 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:14.140825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1028/2071] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:14.655003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:14.657723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:14.677571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f1965-67cd-4cb8-b526-659588f11c65 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:14.688934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f1965-67cd-4cb8-b526-659588f11c65 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:14.694392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f192e3a-4913-4cdf-b19b-6281fc0b8aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:14.695059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f192e3a-4913-4cdf-b19b-6281fc0b8aad service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:14.695379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f192e3a-4913-4cdf-b19b-6281fc0b8aad service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:14.695803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f192e3a-4913-4cdf-b19b-6281fc0b8aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:14.708094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f192e3a-4913-4cdf-b19b-6281fc0b8aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:14.709908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f192e3a-4913-4cdf-b19b-6281fc0b8aad service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:14.723289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1029/2072] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:59:14.734045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336dbb-8e83-485a-aa4f-30b7a9391670 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:14.738797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:14.739702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:14.739976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:14.740487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] PATH_INFO: `/v3/users/8522fa28726b4abbbc022de1c37fee11` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:14.741832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8522fa28726b4abbbc022de1c37fee11)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:14.743825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:14.803327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8522fa28726b4abbbc022de1c37fee11'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:14.812340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8522fa28726b4abbbc022de1c37fee11'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:14.823558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8522fa28726b4abbbc022de1c37fee11'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:14.824605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8522fa28726b4abbbc022de1c37fee11'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:14.841230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8522fa28726b4abbbc022de1c37fee11'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:14.849948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1044/2073] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:14 2022] DELETE /identity/v3/users/8522fa28726b4abbbc022de1c37fee11 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:14.855466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8ec50-1214-447a-90db-26230531da36 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:14.855928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8ec50-1214-447a-90db-26230531da36 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:14.856372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8ec50-1214-447a-90db-26230531da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:14.877250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-79b8ec50-1214-447a-90db-26230531da36 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:14.878585 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-79b8ec50-1214-447a-90db-26230531da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:14.950285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1030/2074] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:14.960605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:14.962163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:15.023741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a701abb-4708-4dff-8c8f-9d4a69bd950d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:15.027407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a145afb-c73a-43e5-a1d0-a90850999fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:15.028054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145afb-c73a-43e5-a1d0-a90850999fbf service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.028330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145afb-c73a-43e5-a1d0-a90850999fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.028596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145afb-c73a-43e5-a1d0-a90850999fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.037383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a145afb-c73a-43e5-a1d0-a90850999fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:15.038793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a145afb-c73a-43e5-a1d0-a90850999fbf service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:15.048058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1045/2075] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:15.438108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8ec50-1214-447a-90db-26230531da36 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:15.439627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-79b8ec50-1214-447a-90db-26230531da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:15.453029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8ec50-1214-447a-90db-26230531da36 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:15.457736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:15.458608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.458885 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.459179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] PATH_INFO: `/v3/projects/c6ef1c88946b43a4a38adb2597263432` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.460398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ef1c88946b43a4a38adb2597263432)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:15.462389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:15.511057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ef1c88946b43a4a38adb2597263432', 'request_id': 'req-5226d07f-35f6-47e2-8cf1-f36437e117f5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:15.517548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ef1c88946b43a4a38adb2597263432', 'request_id': 'req-5226d07f-35f6-47e2-8cf1-f36437e117f5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:15.524745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ef1c88946b43a4a38adb2597263432', 'request_id': 'req-5226d07f-35f6-47e2-8cf1-f36437e117f5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:15.536254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] The token cache is being invalidate because project c6ef1c88946b43a4a38adb2597263432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:15.536544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:15.537190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5226d07f-35f6-47e2-8cf1-f36437e117f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:15.538855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1031/2076] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:15 2022] DELETE /identity/v3/projects/c6ef1c88946b43a4a38adb2597263432 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:15.544407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efc549-ec2a-4252-aef5-76b9e536889c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.544759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efc549-ec2a-4252-aef5-76b9e536889c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.545111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efc549-ec2a-4252-aef5-76b9e536889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.563400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d6efc549-ec2a-4252-aef5-76b9e536889c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:15.564587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d6efc549-ec2a-4252-aef5-76b9e536889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:15.622198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1046/2077] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:15.631002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39bd7-41c7-49b3-9873-834c3f1fd38b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.631317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39bd7-41c7-49b3-9873-834c3f1fd38b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.631604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39bd7-41c7-49b3-9873-834c3f1fd38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.652472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-6cc39bd7-41c7-49b3-9873-834c3f1fd38b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:15.653711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6cc39bd7-41c7-49b3-9873-834c3f1fd38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:15.661894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1032/2078] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:15.666008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efc549-ec2a-4252-aef5-76b9e536889c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:15.676873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efc549-ec2a-4252-aef5-76b9e536889c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:15.681586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:15.682180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.682459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.682732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.683511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:59:15.683817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:15.685777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:15.698433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1047/2079] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:59:15.702696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39bd7-41c7-49b3-9873-834c3f1fd38b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:15.711841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39bd7-41c7-49b3-9873-834c3f1fd38b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:15.716466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63581f-803e-4257-ad5a-f9ced08d7c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:15.717113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63581f-803e-4257-ad5a-f9ced08d7c3e admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.717389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63581f-803e-4257-ad5a-f9ced08d7c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.717653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63581f-803e-4257-ad5a-f9ced08d7c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.718344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63581f-803e-4257-ad5a-f9ced08d7c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:15.720350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63581f-803e-4257-ad5a-f9ced08d7c3e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:15.751863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1033/2080] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:15 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:15.752932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:15.765064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47cdcd-5be5-411b-900a-33c31bffeaaf admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:15.822889 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47632e-bf44-430e-8bec-01b68f4ad21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:15.823587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47632e-bf44-430e-8bec-01b68f4ad21d admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.823869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47632e-bf44-430e-8bec-01b68f4ad21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.824138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47632e-bf44-430e-8bec-01b68f4ad21d admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.824827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47632e-bf44-430e-8bec-01b68f4ad21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:15.826795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47632e-bf44-430e-8bec-01b68f4ad21d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:15.845748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1048/2081] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:15 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:15.850300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63581f-803e-4257-ad5a-f9ced08d7c3e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:15.861058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63581f-803e-4257-ad5a-f9ced08d7c3e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:15.866209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9adcb-0d35-4226-9115-b2bfbd1a52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:15.866859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9adcb-0d35-4226-9115-b2bfbd1a52ae admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.867140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9adcb-0d35-4226-9115-b2bfbd1a52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.867477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9adcb-0d35-4226-9115-b2bfbd1a52ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.868205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9adcb-0d35-4226-9115-b2bfbd1a52ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:15.870206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9adcb-0d35-4226-9115-b2bfbd1a52ae admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:15.881051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1034/2082] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:15.885207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47632e-bf44-430e-8bec-01b68f4ad21d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:15.898795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47632e-bf44-430e-8bec-01b68f4ad21d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:15.903831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e76c25-939c-4901-834e-02ef00307936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:15.904365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e76c25-939c-4901-834e-02ef00307936 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.904644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e76c25-939c-4901-834e-02ef00307936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.904916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e76c25-939c-4901-834e-02ef00307936 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.905672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e76c25-939c-4901-834e-02ef00307936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:15.907464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e76c25-939c-4901-834e-02ef00307936 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:15.918623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1049/2083] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:15.922821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9adcb-0d35-4226-9115-b2bfbd1a52ae admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:15.934362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9adcb-0d35-4226-9115-b2bfbd1a52ae admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:15.939146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:15.939913 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.940190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.940458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] PATH_INFO: `/v3/projects/7d1d877d09894265a3ecb65f70684a29/users/521ce300deaf4ebba282688e5b8fa394/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:15.957779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1d877d09894265a3ecb65f70684a29, user_id=521ce300deaf4ebba282688e5b8fa394, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:15.961083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:15.977405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1035/2084] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:15 2022] PUT /identity/v3/projects/7d1d877d09894265a3ecb65f70684a29/users/521ce300deaf4ebba282688e5b8fa394/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:15.982725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8512c-1502-42a2-934a-37f7eee0fd23 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:15.983014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8512c-1502-42a2-934a-37f7eee0fd23 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:15.983282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8512c-1502-42a2-934a-37f7eee0fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:16.003169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5cd8512c-1502-42a2-934a-37f7eee0fd23 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:16.004588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5cd8512c-1502-42a2-934a-37f7eee0fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:16.068597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1050/2085] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:16.085471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:16.090002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:16.188769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b6742-f589-45cf-8527-68eff2f43e68 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:16.193038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47146cb2-613d-4ecc-a8f8-bae3deb4982f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:16.193696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146cb2-613d-4ecc-a8f8-bae3deb4982f service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:16.194000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146cb2-613d-4ecc-a8f8-bae3deb4982f service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:16.194547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146cb2-613d-4ecc-a8f8-bae3deb4982f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:16.205013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47146cb2-613d-4ecc-a8f8-bae3deb4982f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:16.206823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47146cb2-613d-4ecc-a8f8-bae3deb4982f service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:16.224222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1036/2086] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:20.735734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183df67-f184-4f42-96fd-11fdb7e56386 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:20.736405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183df67-f184-4f42-96fd-11fdb7e56386 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:20.736870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183df67-f184-4f42-96fd-11fdb7e56386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:20.778154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-3183df67-f184-4f42-96fd-11fdb7e56386 None None] MFA Rules not processed for user `521ce300deaf4ebba282688e5b8fa394`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:20.779587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3183df67-f184-4f42-96fd-11fdb7e56386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:20.864483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1051/2087] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:20.870219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47146cb2-613d-4ecc-a8f8-bae3deb4982f service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:20.872360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183df67-f184-4f42-96fd-11fdb7e56386 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:20.873727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3183df67-f184-4f42-96fd-11fdb7e56386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:20.878849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47146cb2-613d-4ecc-a8f8-bae3deb4982f service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:20.883565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c8f14-c16f-432b-89b8-a3ee755f5eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:20.884231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c8f14-c16f-432b-89b8-a3ee755f5eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:20.884512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c8f14-c16f-432b-89b8-a3ee755f5eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:20.884779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c8f14-c16f-432b-89b8-a3ee755f5eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:20.885490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c8f14-c16f-432b-89b8-a3ee755f5eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:20.887430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c8f14-c16f-432b-89b8-a3ee755f5eb9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:20.888301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183df67-f184-4f42-96fd-11fdb7e56386 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:20.895003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:20.896055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:20.896411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:20.896689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] PATH_INFO: `/v3/users/888f18f9fa5b4dfabae1d48cba5f9ce7` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:20.898040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888f18f9fa5b4dfabae1d48cba5f9ce7)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:20.900173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:20.916542 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1037/2088] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:20 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:20.920442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c8f14-c16f-432b-89b8-a3ee755f5eb9 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:20.952852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888f18f9fa5b4dfabae1d48cba5f9ce7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:20.960738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888f18f9fa5b4dfabae1d48cba5f9ce7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:20.970931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888f18f9fa5b4dfabae1d48cba5f9ce7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:20.972123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888f18f9fa5b4dfabae1d48cba5f9ce7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:20.988226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-db087db7-e945-404d-810b-5616371d8e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888f18f9fa5b4dfabae1d48cba5f9ce7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:20.989705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c8f14-c16f-432b-89b8-a3ee755f5eb9 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:20.995033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1052/2089] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:20 2022] DELETE /identity/v3/users/888f18f9fa5b4dfabae1d48cba5f9ce7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:20.996278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:20.996955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:20.997237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:20.997518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:20.998667 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:20.999731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e72ff-60b5-417f-a438-ac574c0130e5 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:21.000098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e72ff-60b5-417f-a438-ac574c0130e5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:21.000450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e72ff-60b5-417f-a438-ac574c0130e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:21.000954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:21.021197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-739e72ff-60b5-417f-a438-ac574c0130e5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:21.022550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-739e72ff-60b5-417f-a438-ac574c0130e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:21.026811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1038/2090] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:20 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:21.030566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:21.032437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:21.045890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccda09-f69f-42f7-b37b-a40b5210645d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:21.101858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1053/2091] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:21.111268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e72ff-60b5-417f-a438-ac574c0130e5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:21.112922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-739e72ff-60b5-417f-a438-ac574c0130e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:21.113567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bec18-b0db-49e4-bab1-2f5bece31ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:21.114411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bec18-b0db-49e4-bab1-2f5bece31ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:21.114699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bec18-b0db-49e4-bab1-2f5bece31ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:21.114977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bec18-b0db-49e4-bab1-2f5bece31ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:21.115740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bec18-b0db-49e4-bab1-2f5bece31ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:21.117341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bec18-b0db-49e4-bab1-2f5bece31ccd admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:21.128266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1039/2092] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:21.132879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bec18-b0db-49e4-bab1-2f5bece31ccd admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:21.145012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bec18-b0db-49e4-bab1-2f5bece31ccd admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:21.150377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430485e-ccd8-4f17-8a60-659befdef07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:21.151352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430485e-ccd8-4f17-8a60-659befdef07c admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:21.151886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430485e-ccd8-4f17-8a60-659befdef07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:21.152360 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430485e-ccd8-4f17-8a60-659befdef07c admin admin] PATH_INFO: `/v3/projects/7208709de9ce4cfd9176966e1b5a4428/users/adfe6c1c0fae4e90a76377c4776711b0/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:21.169417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430485e-ccd8-4f17-8a60-659befdef07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7208709de9ce4cfd9176966e1b5a4428, user_id=adfe6c1c0fae4e90a76377c4776711b0, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:21.172207 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430485e-ccd8-4f17-8a60-659befdef07c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:21.180955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e72ff-60b5-417f-a438-ac574c0130e5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:21.191793 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1040/2093] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:21 2022] PUT /identity/v3/projects/7208709de9ce4cfd9176966e1b5a4428/users/adfe6c1c0fae4e90a76377c4776711b0/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:21.192876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430485e-ccd8-4f17-8a60-659befdef07c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:21.246990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0b82-059d-4b41-80da-32d5daca3f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:21.248202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0b82-059d-4b41-80da-32d5daca3f05 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:21.248712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0b82-059d-4b41-80da-32d5daca3f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:21.249060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0b82-059d-4b41-80da-32d5daca3f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:21.267616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430485e-ccd8-4f17-8a60-659befdef07c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:21.273186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29063234-b868-4f5d-86b2-31aeb1299c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:21.273854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29063234-b868-4f5d-86b2-31aeb1299c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:21.274137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29063234-b868-4f5d-86b2-31aeb1299c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:21.274505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29063234-b868-4f5d-86b2-31aeb1299c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:21.275408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29063234-b868-4f5d-86b2-31aeb1299c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:21.276888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29063234-b868-4f5d-86b2-31aeb1299c6b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:21.290256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1041/2094] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:21.291752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29063234-b868-4f5d-86b2-31aeb1299c6b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:21.301921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29063234-b868-4f5d-86b2-31aeb1299c6b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:21.306732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:21.307652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:21.308281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:21.308281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] PATH_INFO: `/v3/projects/7208709de9ce4cfd9176966e1b5a4428/users/adfe6c1c0fae4e90a76377c4776711b0/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:21.310552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7208709de9ce4cfd9176966e1b5a4428, user_id=adfe6c1c0fae4e90a76377c4776711b0, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:21.313304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:21.325408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1042/2095] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:21 2022] PUT /identity/v3/projects/7208709de9ce4cfd9176966e1b5a4428/users/adfe6c1c0fae4e90a76377c4776711b0/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:59:21.328113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0b82-059d-4b41-80da-32d5daca3f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:21.330049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0b82-059d-4b41-80da-32d5daca3f05 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:21.341082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1054/2096] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 18:59:21.705786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:21.707879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:21.788423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e25d-46ee-46a8-8aef-f013281474c5 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:21.793193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:21.794006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:21.794359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:21.794761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] PATH_INFO: `/v3/projects/7f10e4faa19f42ada6e96504c417e1f6` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:21.795996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f10e4faa19f42ada6e96504c417e1f6)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:21.798121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:21.854895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f10e4faa19f42ada6e96504c417e1f6', 'request_id': 'req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:21.861916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f10e4faa19f42ada6e96504c417e1f6', 'request_id': 'req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:21.873026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f10e4faa19f42ada6e96504c417e1f6', 'request_id': 'req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:21.885572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] The token cache is being invalidate because project 7f10e4faa19f42ada6e96504c417e1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:21.885865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:21.886550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:21.888117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1043/2097] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:21 2022] DELETE /identity/v3/projects/7f10e4faa19f42ada6e96504c417e1f6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:21.892159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0b82-059d-4b41-80da-32d5daca3f05 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:21.901719 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0b82-059d-4b41-80da-32d5daca3f05 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:21.961091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:21.962242 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:21.962522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:21.962795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] PATH_INFO: `/v3/users/d32c15c5010c4ff4ae39d8a2715a38a4` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:21.963997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32c15c5010c4ff4ae39d8a2715a38a4)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:21.965959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:22.032453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32c15c5010c4ff4ae39d8a2715a38a4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.043548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32c15c5010c4ff4ae39d8a2715a38a4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.052611 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32c15c5010c4ff4ae39d8a2715a38a4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.053600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32c15c5010c4ff4ae39d8a2715a38a4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.072783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32c15c5010c4ff4ae39d8a2715a38a4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.081630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1055/2098] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:21 2022] DELETE /identity/v3/users/d32c15c5010c4ff4ae39d8a2715a38a4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:22.558988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:22.560510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:22.583797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d6eeb-fbc2-46c7-b771-1cd513d9fdb1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:22.648290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:22.649240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:22.649498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:22.649769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] PATH_INFO: `/v3/projects/af1291d04c4c4b96bf6f76ccfaf2cf2c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:22.651110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1291d04c4c4b96bf6f76ccfaf2cf2c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:22.653061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:22.700752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1291d04c4c4b96bf6f76ccfaf2cf2c', 'request_id': 'req-a1114dbd-fb2f-437f-8835-87fe679fa130'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.708378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1291d04c4c4b96bf6f76ccfaf2cf2c', 'request_id': 'req-a1114dbd-fb2f-437f-8835-87fe679fa130'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.720744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1291d04c4c4b96bf6f76ccfaf2cf2c', 'request_id': 'req-a1114dbd-fb2f-437f-8835-87fe679fa130'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.734620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] The token cache is being invalidate because project af1291d04c4c4b96bf6f76ccfaf2cf2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:22.735044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.735924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.737810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1044/2099] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:22 2022] DELETE /identity/v3/projects/af1291d04c4c4b96bf6f76ccfaf2cf2c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:22.741544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:22.743576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:22.757882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab627811-5cc8-4a09-9a7c-3eb5893429eb admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:22.822784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:22.823732 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:22.824010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:22.824280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] PATH_INFO: `/v3/users/f9e07a73a1ea423ca3a942be405de2bb` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:22.825637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e07a73a1ea423ca3a942be405de2bb)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:22.827615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:22.881383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e07a73a1ea423ca3a942be405de2bb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.888934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e07a73a1ea423ca3a942be405de2bb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.899500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e07a73a1ea423ca3a942be405de2bb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.900154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e07a73a1ea423ca3a942be405de2bb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.913744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71c5bf96-9145-48d0-97a7-9bd597e1ffc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e07a73a1ea423ca3a942be405de2bb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:22.920657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1056/2100] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:22 2022] DELETE /identity/v3/users/f9e07a73a1ea423ca3a942be405de2bb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:23.917832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:23.919454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:23.956215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114dbd-fb2f-437f-8835-87fe679fa130 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:24.069866 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:24.070848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.071202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.071633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] PATH_INFO: `/v3/projects/462a938b94a2412487de16c3281e1f52` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.073135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462a938b94a2412487de16c3281e1f52)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:24.075247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:24.143188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462a938b94a2412487de16c3281e1f52', 'request_id': 'req-57278433-5dc4-407c-abdd-98285cff2c39'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:24.153013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462a938b94a2412487de16c3281e1f52', 'request_id': 'req-57278433-5dc4-407c-abdd-98285cff2c39'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:24.171783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462a938b94a2412487de16c3281e1f52', 'request_id': 'req-57278433-5dc4-407c-abdd-98285cff2c39'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:24.192566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] The token cache is being invalidate because project 462a938b94a2412487de16c3281e1f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:24.193695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:24.194713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-57278433-5dc4-407c-abdd-98285cff2c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:24.197035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1045/2101] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:23 2022] DELETE /identity/v3/projects/462a938b94a2412487de16c3281e1f52 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:24.211947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83288183-cc06-41e4-a231-ee339c3dce0e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.212418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83288183-cc06-41e4-a231-ee339c3dce0e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.212502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83288183-cc06-41e4-a231-ee339c3dce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.247547 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-83288183-cc06-41e4-a231-ee339c3dce0e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:24.249526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-83288183-cc06-41e4-a231-ee339c3dce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:24.361315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1057/2102] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:24.363710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fef2d-2516-49a3-b623-4c4d3344d578 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.364003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fef2d-2516-49a3-b623-4c4d3344d578 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.364279 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fef2d-2516-49a3-b623-4c4d3344d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.397549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d28fef2d-2516-49a3-b623-4c4d3344d578 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:24.399409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d28fef2d-2516-49a3-b623-4c4d3344d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:24.420455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1046/2103] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:24.424420 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83288183-cc06-41e4-a231-ee339c3dce0e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:24.437039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83288183-cc06-41e4-a231-ee339c3dce0e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:24.452580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:24.453264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.453544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.453820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.454561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:59:24.454994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:24.456643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:24.475621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1058/2104] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:59:24.479565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fef2d-2516-49a3-b623-4c4d3344d578 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:24.491899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fef2d-2516-49a3-b623-4c4d3344d578 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:24.496780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118389d-4a04-41f0-aa0b-745a9d061bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:24.497445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118389d-4a04-41f0-aa0b-745a9d061bef admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.497724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118389d-4a04-41f0-aa0b-745a9d061bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.497997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118389d-4a04-41f0-aa0b-745a9d061bef admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.498761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118389d-4a04-41f0-aa0b-745a9d061bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:24.500743 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118389d-4a04-41f0-aa0b-745a9d061bef admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:24.551334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1047/2105] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:24 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:24.554099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:24.571420 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a48dc-3e75-46e4-aaa3-27908af4647d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:24.661914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8782aa8-5e76-4b18-8565-a08de8604629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:24.669970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8782aa8-5e76-4b18-8565-a08de8604629 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.670277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8782aa8-5e76-4b18-8565-a08de8604629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.670562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8782aa8-5e76-4b18-8565-a08de8604629 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.671928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8782aa8-5e76-4b18-8565-a08de8604629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:24.678985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8782aa8-5e76-4b18-8565-a08de8604629 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:24.733977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1059/2106] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:24 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:24.738841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118389d-4a04-41f0-aa0b-745a9d061bef admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:24.753061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118389d-4a04-41f0-aa0b-745a9d061bef admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:24.766171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4cbbb-726f-48e6-9ece-db36736bbe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:24.766903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4cbbb-726f-48e6-9ece-db36736bbe82 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.767773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4cbbb-726f-48e6-9ece-db36736bbe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.767773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4cbbb-726f-48e6-9ece-db36736bbe82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.769740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4cbbb-726f-48e6-9ece-db36736bbe82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:24.776283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4cbbb-726f-48e6-9ece-db36736bbe82 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:24.798342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1048/2107] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:24.802922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8782aa8-5e76-4b18-8565-a08de8604629 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:24.817718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8782aa8-5e76-4b18-8565-a08de8604629 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:24.838802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fe190-ac72-4b84-93ef-928cc5620a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:24.839573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe190-ac72-4b84-93ef-928cc5620a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.839858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe190-ac72-4b84-93ef-928cc5620a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.840133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fe190-ac72-4b84-93ef-928cc5620a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.840888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fe190-ac72-4b84-93ef-928cc5620a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:24.843506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fe190-ac72-4b84-93ef-928cc5620a98 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:24.875061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1060/2108] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:24.877729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4cbbb-726f-48e6-9ece-db36736bbe82 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:24.901296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4cbbb-726f-48e6-9ece-db36736bbe82 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:24.906358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:24.907774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:24.908055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:24.911228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] PATH_INFO: `/v3/projects/8b2f4f14c6d74faa8101909665e1d583/users/2b7f7b78e49643bda9e80fef72dbacbe/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:24.981649 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2f4f14c6d74faa8101909665e1d583, user_id=2b7f7b78e49643bda9e80fef72dbacbe, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:24.995056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:25.024451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1049/2109] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:24 2022] PUT /identity/v3/projects/8b2f4f14c6d74faa8101909665e1d583/users/2b7f7b78e49643bda9e80fef72dbacbe/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:25.035422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821f6d0-88f9-4eb6-b87e-b307b6cfd0a4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:25.037503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821f6d0-88f9-4eb6-b87e-b307b6cfd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:25.037887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821f6d0-88f9-4eb6-b87e-b307b6cfd0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:25.116162 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-2821f6d0-88f9-4eb6-b87e-b307b6cfd0a4 None None] MFA Rules not processed for user `2b7f7b78e49643bda9e80fef72dbacbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:25.122548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2821f6d0-88f9-4eb6-b87e-b307b6cfd0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:25.304614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1061/2110] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:25.314138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:25.316791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:25.483929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a753150-158e-42da-957a-d53e87147053 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:25.491110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e0aeb-4ea5-4968-b8e8-bfc643ab2c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:25.492431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0aeb-4ea5-4968-b8e8-bfc643ab2c4e service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:25.493500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0aeb-4ea5-4968-b8e8-bfc643ab2c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:25.493914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0aeb-4ea5-4968-b8e8-bfc643ab2c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:25.505866 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e0aeb-4ea5-4968-b8e8-bfc643ab2c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:25.507556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e0aeb-4ea5-4968-b8e8-bfc643ab2c4e service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:25.520094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1050/2111] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:25.557551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821f6d0-88f9-4eb6-b87e-b307b6cfd0a4 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:25.670472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821f6d0-88f9-4eb6-b87e-b307b6cfd0a4 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:25.678380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:25.680323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:25.683714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:25.684135 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] PATH_INFO: `/v3/users/2b7f7b78e49643bda9e80fef72dbacbe` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:25.688304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7f7b78e49643bda9e80fef72dbacbe)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:25.690512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:25.803947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7f7b78e49643bda9e80fef72dbacbe'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:25.821668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7f7b78e49643bda9e80fef72dbacbe'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:25.838580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7f7b78e49643bda9e80fef72dbacbe'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:25.839220 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7f7b78e49643bda9e80fef72dbacbe'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:25.862643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7f7b78e49643bda9e80fef72dbacbe'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:25.870580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1062/2112] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:25 2022] DELETE /identity/v3/users/2b7f7b78e49643bda9e80fef72dbacbe => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:59:25.876062 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ee87-6d8e-40e6-9a0c-55fd0a51cc97 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:25.876345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ee87-6d8e-40e6-9a0c-55fd0a51cc97 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:25.876618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ee87-6d8e-40e6-9a0c-55fd0a51cc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:25.911080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a6f8ee87-6d8e-40e6-9a0c-55fd0a51cc97 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:25.920700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a6f8ee87-6d8e-40e6-9a0c-55fd0a51cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:26.042450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1051/2113] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:26.062143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:26.065281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:26.187776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2b9fb-67a5-47b6-a005-84329af2635a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:26.201780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af610-adc6-48a8-af43-0a7ddff3a7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:26.202567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af610-adc6-48a8-af43-0a7ddff3a7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:26.202958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af610-adc6-48a8-af43-0a7ddff3a7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:26.203335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af610-adc6-48a8-af43-0a7ddff3a7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:26.224369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2af610-adc6-48a8-af43-0a7ddff3a7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:26.225872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2af610-adc6-48a8-af43-0a7ddff3a7b2 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:26.249149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1063/2114] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:27.099685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ee87-6d8e-40e6-9a0c-55fd0a51cc97 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:27.102447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a6f8ee87-6d8e-40e6-9a0c-55fd0a51cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:27.126273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ee87-6d8e-40e6-9a0c-55fd0a51cc97 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:27.137741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:27.138859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.139371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.139981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] PATH_INFO: `/v3/projects/8b2f4f14c6d74faa8101909665e1d583` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.142017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2f4f14c6d74faa8101909665e1d583)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:27.146481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:27.216777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2f4f14c6d74faa8101909665e1d583', 'request_id': 'req-d3558d5f-bcc5-445e-a701-d489605b9bbb'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:27.224150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2f4f14c6d74faa8101909665e1d583', 'request_id': 'req-d3558d5f-bcc5-445e-a701-d489605b9bbb'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:27.236187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2f4f14c6d74faa8101909665e1d583', 'request_id': 'req-d3558d5f-bcc5-445e-a701-d489605b9bbb'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:27.252032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] The token cache is being invalidate because project 8b2f4f14c6d74faa8101909665e1d583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:27.252244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:27.252870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d3558d5f-bcc5-445e-a701-d489605b9bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:27.258333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1052/2115] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:27 2022] DELETE /identity/v3/projects/8b2f4f14c6d74faa8101909665e1d583 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:27.260443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb8aa-eff9-4524-9516-64ab668c3a77 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.260993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb8aa-eff9-4524-9516-64ab668c3a77 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.261347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb8aa-eff9-4524-9516-64ab668c3a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.283668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-200bb8aa-eff9-4524-9516-64ab668c3a77 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:27.288128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-200bb8aa-eff9-4524-9516-64ab668c3a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:27.382384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1064/2116] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:27.392789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca966d6-9a57-487a-880b-d5af9234b2f1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.393456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca966d6-9a57-487a-880b-d5af9234b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.393899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca966d6-9a57-487a-880b-d5af9234b2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.436564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4ca966d6-9a57-487a-880b-d5af9234b2f1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:27.438296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4ca966d6-9a57-487a-880b-d5af9234b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:27.453613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1053/2117] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:27.454671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bb8aa-eff9-4524-9516-64ab668c3a77 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:27.467962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bb8aa-eff9-4524-9516-64ab668c3a77 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:27.490276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:27.491381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.491966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.492685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.495883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:59:27.496354 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:27.498438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:27.520013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1065/2118] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:59:27.525130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca966d6-9a57-487a-880b-d5af9234b2f1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:27.536815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca966d6-9a57-487a-880b-d5af9234b2f1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:27.543042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587528-3fd1-4937-9774-241ce123066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:27.544639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587528-3fd1-4937-9774-241ce123066c admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.545013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587528-3fd1-4937-9774-241ce123066c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.545392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587528-3fd1-4937-9774-241ce123066c admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.546513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587528-3fd1-4937-9774-241ce123066c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:27.548696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587528-3fd1-4937-9774-241ce123066c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:27.603892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:27.621418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1054/2119] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:27 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:27.624071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2fee8-7359-4dc2-b74e-6a2ab11f7705 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:27.701220 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec2279-33a0-4594-a6d7-6a6c8cf09537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:27.702186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2279-33a0-4594-a6d7-6a6c8cf09537 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.702627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2279-33a0-4594-a6d7-6a6c8cf09537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.703240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2279-33a0-4594-a6d7-6a6c8cf09537 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.704118 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec2279-33a0-4594-a6d7-6a6c8cf09537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:27.706281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec2279-33a0-4594-a6d7-6a6c8cf09537 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:27.739116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1066/2120] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:27 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:27.740767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587528-3fd1-4937-9774-241ce123066c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:27.753031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587528-3fd1-4937-9774-241ce123066c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:27.758559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79717afd-ea0b-4c23-a8b7-df52c33b5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:27.759405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717afd-ea0b-4c23-a8b7-df52c33b5057 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.759694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717afd-ea0b-4c23-a8b7-df52c33b5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.760038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717afd-ea0b-4c23-a8b7-df52c33b5057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.761140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79717afd-ea0b-4c23-a8b7-df52c33b5057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:27.763123 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79717afd-ea0b-4c23-a8b7-df52c33b5057 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:27.776958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1055/2121] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:27.781391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec2279-33a0-4594-a6d7-6a6c8cf09537 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:27.794586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec2279-33a0-4594-a6d7-6a6c8cf09537 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:27.801413 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f365a4-7000-42f7-944f-76d993105adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:27.802586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f365a4-7000-42f7-944f-76d993105adf admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.804060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f365a4-7000-42f7-944f-76d993105adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.805074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f365a4-7000-42f7-944f-76d993105adf admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.806317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f365a4-7000-42f7-944f-76d993105adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:27.808474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f365a4-7000-42f7-944f-76d993105adf admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:27.829387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1067/2122] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:27.834161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79717afd-ea0b-4c23-a8b7-df52c33b5057 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:27.845030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79717afd-ea0b-4c23-a8b7-df52c33b5057 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:27.850779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:27.851945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.858982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.859346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] PATH_INFO: `/v3/projects/4be93dc182224cfe8be43a23dadbb62f/users/2558a8c34b324bc99b157b306c9cdf7b/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.878926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be93dc182224cfe8be43a23dadbb62f, user_id=2558a8c34b324bc99b157b306c9cdf7b, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:27.882305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:27.915271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1056/2123] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:27 2022] PUT /identity/v3/projects/4be93dc182224cfe8be43a23dadbb62f/users/2558a8c34b324bc99b157b306c9cdf7b/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:27.917286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a32f3-3ddf-477c-9660-e8db4a5ad72a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:27.917286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a32f3-3ddf-477c-9660-e8db4a5ad72a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:27.917569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a32f3-3ddf-477c-9660-e8db4a5ad72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:27.937215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e50a32f3-3ddf-477c-9660-e8db4a5ad72a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:27.938465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e50a32f3-3ddf-477c-9660-e8db4a5ad72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:28.037418 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1068/2124] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:28.048352 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:28.050437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:28.145155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1c8b5-03b8-48a7-8520-45f66fdfb787 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:28.157432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:28.161760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:28.162152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:28.163928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:28.177214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:28.182503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:28.196763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1057/2125] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:28.383767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682305a-e264-4c9a-8ee8-66c7bc768d2a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:28.384709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682305a-e264-4c9a-8ee8-66c7bc768d2a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:28.385131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682305a-e264-4c9a-8ee8-66c7bc768d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:28.421999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-6682305a-e264-4c9a-8ee8-66c7bc768d2a None None] MFA Rules not processed for user `adfe6c1c0fae4e90a76377c4776711b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:28.423399 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6682305a-e264-4c9a-8ee8-66c7bc768d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:28.545444 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1069/2126] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:28.560580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:28.563092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:28.739685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d9be-9133-4025-b0c9-62f960f5e60b service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:28.751896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec502af7-a006-4f8a-b329-b0eb56b392e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:28.752666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec502af7-a006-4f8a-b329-b0eb56b392e0 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:28.753050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec502af7-a006-4f8a-b329-b0eb56b392e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:28.753465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec502af7-a006-4f8a-b329-b0eb56b392e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:28.755705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ec502af7-a006-4f8a-b329-b0eb56b392e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:28.859568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec502af7-a006-4f8a-b329-b0eb56b392e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:28.861792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec502af7-a006-4f8a-b329-b0eb56b392e0 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:28.877833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1058/2127] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:30.506966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6305b-a321-4525-8a09-becd9987f538 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:30.507508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6305b-a321-4525-8a09-becd9987f538 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:30.507795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6305b-a321-4525-8a09-becd9987f538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:30.551280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a8b6305b-a321-4525-8a09-becd9987f538 None None] MFA Rules not processed for user `521ce300deaf4ebba282688e5b8fa394`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:30.557961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a8b6305b-a321-4525-8a09-becd9987f538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:30.582898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1070/2128] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:34.678140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283516f-99cc-439d-ad76-953cde29439f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:34.678711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283516f-99cc-439d-ad76-953cde29439f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:34.678711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283516f-99cc-439d-ad76-953cde29439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:34.723968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-6283516f-99cc-439d-ad76-953cde29439f None None] MFA Rules not processed for user `2558a8c34b324bc99b157b306c9cdf7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:34.725288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6283516f-99cc-439d-ad76-953cde29439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:34.828494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1059/2129] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:34.834339 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6305b-a321-4525-8a09-becd9987f538 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:34.846088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6305b-a321-4525-8a09-becd9987f538 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:34.851059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6aa142-66a3-4a23-84dc-1d908ca597a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:34.851788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6aa142-66a3-4a23-84dc-1d908ca597a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:34.852073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6aa142-66a3-4a23-84dc-1d908ca597a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:34.852350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6aa142-66a3-4a23-84dc-1d908ca597a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:34.853045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6aa142-66a3-4a23-84dc-1d908ca597a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:34.854996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6aa142-66a3-4a23-84dc-1d908ca597a7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:34.893101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1071/2130] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:34 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:34.894454 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283516f-99cc-439d-ad76-953cde29439f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:34.910267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283516f-99cc-439d-ad76-953cde29439f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:34.991435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d637f5a-869f-42ff-bdfe-6965895c4222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:34.992180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d637f5a-869f-42ff-bdfe-6965895c4222 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:34.992471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d637f5a-869f-42ff-bdfe-6965895c4222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:34.992922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d637f5a-869f-42ff-bdfe-6965895c4222 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:34.993447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d637f5a-869f-42ff-bdfe-6965895c4222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:34.995402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d637f5a-869f-42ff-bdfe-6965895c4222 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:35.016192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1060/2131] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:34 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:35.020439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6aa142-66a3-4a23-84dc-1d908ca597a7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:35.031104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6aa142-66a3-4a23-84dc-1d908ca597a7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:35.036052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61593ec-9977-4176-a58e-60ebb8ac18d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:35.036729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61593ec-9977-4176-a58e-60ebb8ac18d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:35.037009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61593ec-9977-4176-a58e-60ebb8ac18d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:35.037280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61593ec-9977-4176-a58e-60ebb8ac18d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:35.038014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61593ec-9977-4176-a58e-60ebb8ac18d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:35.039672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61593ec-9977-4176-a58e-60ebb8ac18d2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:35.051320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1072/2132] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:35.055567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d637f5a-869f-42ff-bdfe-6965895c4222 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:35.068219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d637f5a-869f-42ff-bdfe-6965895c4222 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:35.073435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f169cd7-46dd-441b-b0ee-12bcc9b96eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:35.074332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f169cd7-46dd-441b-b0ee-12bcc9b96eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:35.074613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f169cd7-46dd-441b-b0ee-12bcc9b96eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:35.074890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f169cd7-46dd-441b-b0ee-12bcc9b96eb1 admin admin] PATH_INFO: `/v3/projects/566f9e92e0ad427196ce6ed231b95f60/users/9af299ecc293408b9389b0a72d38bbae/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:35.090691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f169cd7-46dd-441b-b0ee-12bcc9b96eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566f9e92e0ad427196ce6ed231b95f60, user_id=9af299ecc293408b9389b0a72d38bbae, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:35.093424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f169cd7-46dd-441b-b0ee-12bcc9b96eb1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:35.106988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1061/2133] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:35 2022] PUT /identity/v3/projects/566f9e92e0ad427196ce6ed231b95f60/users/9af299ecc293408b9389b0a72d38bbae/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:35.110977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61593ec-9977-4176-a58e-60ebb8ac18d2 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:35.122138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61593ec-9977-4176-a58e-60ebb8ac18d2 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:35.187798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:35.188468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:35.188751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:35.189023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:35.189748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:35.191438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:35.202589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1073/2134] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:35.207215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f169cd7-46dd-441b-b0ee-12bcc9b96eb1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:35.218450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f169cd7-46dd-441b-b0ee-12bcc9b96eb1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:35.223823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22064c-a29c-4e05-b76d-748fb19992a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:35.224743 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22064c-a29c-4e05-b76d-748fb19992a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:35.225024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22064c-a29c-4e05-b76d-748fb19992a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:35.225338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22064c-a29c-4e05-b76d-748fb19992a6 admin admin] PATH_INFO: `/v3/projects/566f9e92e0ad427196ce6ed231b95f60/users/9af299ecc293408b9389b0a72d38bbae/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:35.227277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22064c-a29c-4e05-b76d-748fb19992a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566f9e92e0ad427196ce6ed231b95f60, user_id=9af299ecc293408b9389b0a72d38bbae, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:35.229934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22064c-a29c-4e05-b76d-748fb19992a6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:35.240519 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1062/2135] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:35 2022] PUT /identity/v3/projects/566f9e92e0ad427196ce6ed231b95f60/users/9af299ecc293408b9389b0a72d38bbae/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:59:40.185817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:40.187730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:40.209998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0aff5-ae7e-49cd-80a3-889555d1149d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:40.328230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:40.329137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:40.329414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:40.329832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] PATH_INFO: `/v3/users/f5f00857451442969d3e9c54e17bef37` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:40.331132 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f00857451442969d3e9c54e17bef37)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:40.333293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:40.447641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f00857451442969d3e9c54e17bef37'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:40.461500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f00857451442969d3e9c54e17bef37'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:40.479223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f00857451442969d3e9c54e17bef37'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:40.482458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f00857451442969d3e9c54e17bef37'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:40.499838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f00857451442969d3e9c54e17bef37'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:40.507521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1074/2136] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:40 2022] DELETE /identity/v3/users/f5f00857451442969d3e9c54e17bef37 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:40.513271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdce89-e5e1-4bb6-996a-f99abeacb625 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:40.513271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdce89-e5e1-4bb6-996a-f99abeacb625 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:40.513271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdce89-e5e1-4bb6-996a-f99abeacb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:40.549344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-40fdce89-e5e1-4bb6-996a-f99abeacb625 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:40.555283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-40fdce89-e5e1-4bb6-996a-f99abeacb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:40.652685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1063/2137] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:40.668269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:40.671212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:40.785188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d73724-209b-405b-8c5a-5a0753ea32b5 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:40.790078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54380d05-cc12-43ab-90f6-a2ae31a91b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:40.791123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380d05-cc12-43ab-90f6-a2ae31a91b15 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:40.791682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380d05-cc12-43ab-90f6-a2ae31a91b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:40.792158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380d05-cc12-43ab-90f6-a2ae31a91b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:40.805473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54380d05-cc12-43ab-90f6-a2ae31a91b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:40.807086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54380d05-cc12-43ab-90f6-a2ae31a91b15 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:40.822780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1075/2138] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:41.591880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdce89-e5e1-4bb6-996a-f99abeacb625 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:41.593346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-40fdce89-e5e1-4bb6-996a-f99abeacb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:41.605759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdce89-e5e1-4bb6-996a-f99abeacb625 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:41.610399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:41.611934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:41.612226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:41.613073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] PATH_INFO: `/v3/projects/b2edb585df8f449392528b46efbba148` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:41.615018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2edb585df8f449392528b46efbba148)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:41.617165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:41.689329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2edb585df8f449392528b46efbba148', 'request_id': 'req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.698206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2edb585df8f449392528b46efbba148', 'request_id': 'req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.712572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2edb585df8f449392528b46efbba148', 'request_id': 'req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.738314 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] The token cache is being invalidate because project b2edb585df8f449392528b46efbba148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:41.738603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.740650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-1a9c09f9-f2b5-4f53-841b-17f1e5d2b6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.746572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1064/2139] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:41 2022] DELETE /identity/v3/projects/b2edb585df8f449392528b46efbba148 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:41.747318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54380d05-cc12-43ab-90f6-a2ae31a91b15 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:41.760739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54380d05-cc12-43ab-90f6-a2ae31a91b15 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:41.853329 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:41.854524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:41.854953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:41.855480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] PATH_INFO: `/v3/users/da39cbd6c42c4b6f88c47005ce28334c` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:41.857792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da39cbd6c42c4b6f88c47005ce28334c)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:41.860017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:41.929614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da39cbd6c42c4b6f88c47005ce28334c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.948080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da39cbd6c42c4b6f88c47005ce28334c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.962103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da39cbd6c42c4b6f88c47005ce28334c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.962954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da39cbd6c42c4b6f88c47005ce28334c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.980688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da39cbd6c42c4b6f88c47005ce28334c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:41.989775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1076/2140] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:41 2022] DELETE /identity/v3/users/da39cbd6c42c4b6f88c47005ce28334c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:59:42.020479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b09d7-dd7c-4f1d-bf34-264c91346eff None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:42.020865 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b09d7-dd7c-4f1d-bf34-264c91346eff None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:42.021218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b09d7-dd7c-4f1d-bf34-264c91346eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:42.059561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-aa6b09d7-dd7c-4f1d-bf34-264c91346eff None None] MFA Rules not processed for user `9af299ecc293408b9389b0a72d38bbae`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:42.061195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-aa6b09d7-dd7c-4f1d-bf34-264c91346eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:42.185036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1065/2141] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:42.200817 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:42.202787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:42.344530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9651-b13b-407a-811c-7941319ff69a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:42.352382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d9461-2c1c-4034-ad2a-3188cc6592a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:42.353074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9461-2c1c-4034-ad2a-3188cc6592a9 service glance] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:42.353356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9461-2c1c-4034-ad2a-3188cc6592a9 service glance] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:42.353646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9461-2c1c-4034-ad2a-3188cc6592a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:42.355720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-441d9461-2c1c-4034-ad2a-3188cc6592a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:42.476189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b09d7-dd7c-4f1d-bf34-264c91346eff None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:42.482971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-aa6b09d7-dd7c-4f1d-bf34-264c91346eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:42.485222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9461-2c1c-4034-ad2a-3188cc6592a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:42.491709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9461-2c1c-4034-ad2a-3188cc6592a9 service glance] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:42.506969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1077/2142] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:42.680875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5284-0511-4084-ad9f-0b74324acfb4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:42.681163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5284-0511-4084-ad9f-0b74324acfb4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:42.681471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5284-0511-4084-ad9f-0b74324acfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:42.704115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b09d7-dd7c-4f1d-bf34-264c91346eff None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:42.710734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:42.711776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:42.712143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:42.712488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] PATH_INFO: `/v3/projects/114820553e574c61bbebc02fec21dc65` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:42.715409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b03a5284-0511-4084-ad9f-0b74324acfb4 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:42.715557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114820553e574c61bbebc02fec21dc65)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:42.716855 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b03a5284-0511-4084-ad9f-0b74324acfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:42.717955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:42.790896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114820553e574c61bbebc02fec21dc65', 'request_id': 'req-3d6159c1-a979-4d24-b6ab-6336af2390c7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:42.797878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114820553e574c61bbebc02fec21dc65', 'request_id': 'req-3d6159c1-a979-4d24-b6ab-6336af2390c7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:42.807738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114820553e574c61bbebc02fec21dc65', 'request_id': 'req-3d6159c1-a979-4d24-b6ab-6336af2390c7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:42.820150 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] The token cache is being invalidate because project 114820553e574c61bbebc02fec21dc65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:42.820478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:42.821080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3d6159c1-a979-4d24-b6ab-6336af2390c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:42.823104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1066/2143] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:42 2022] DELETE /identity/v3/projects/114820553e574c61bbebc02fec21dc65 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:42.827750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1e2c-f4e0-41e8-ab74-0fbd51639be9 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:42.828035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1e2c-f4e0-41e8-ab74-0fbd51639be9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:42.828309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1e2c-f4e0-41e8-ab74-0fbd51639be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:42.831466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1078/2144] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:42.850825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5284-0511-4084-ad9f-0b74324acfb4 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:42.853043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b03a5284-0511-4084-ad9f-0b74324acfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:42.883926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-fe4c1e2c-f4e0-41e8-ab74-0fbd51639be9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:42.885122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-fe4c1e2c-f4e0-41e8-ab74-0fbd51639be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:42.920834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5284-0511-4084-ad9f-0b74324acfb4 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:42.944370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1067/2145] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:42.952044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b057d-8346-41d7-a731-897161bfd33d None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:42.952330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b057d-8346-41d7-a731-897161bfd33d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:42.952600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b057d-8346-41d7-a731-897161bfd33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:42.970543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4b9b057d-8346-41d7-a731-897161bfd33d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:42.972313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4b9b057d-8346-41d7-a731-897161bfd33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:42.980389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1068/2146] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:42.982643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc09f-a86c-469c-9d2b-a6340df29f77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:42.983436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc09f-a86c-469c-9d2b-a6340df29f77 service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:42.983676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc09f-a86c-469c-9d2b-a6340df29f77 service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:42.983948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc09f-a86c-469c-9d2b-a6340df29f77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:42.985309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b057d-8346-41d7-a731-897161bfd33d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:42.996599 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b057d-8346-41d7-a731-897161bfd33d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.001765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.002410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.002683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.002983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.003729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:59:43.004028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.005638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.017569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1069/2147] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:59:43.021456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.030664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f767554-a0a6-4282-bf82-429948723273 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.036675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eee2b-f434-4c40-8e31-e4c0c6f5560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.037468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eee2b-f434-4c40-8e31-e4c0c6f5560f admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.037751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eee2b-f434-4c40-8e31-e4c0c6f5560f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.038024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eee2b-f434-4c40-8e31-e4c0c6f5560f admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.038718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eee2b-f434-4c40-8e31-e4c0c6f5560f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.040640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eee2b-f434-4c40-8e31-e4c0c6f5560f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.047006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abc09f-a86c-469c-9d2b-a6340df29f77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.048643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abc09f-a86c-469c-9d2b-a6340df29f77 service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.057431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1079/2148] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 18:59:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 18:59:43.068008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1070/2149] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:43 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:43.072674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc09f-a86c-469c-9d2b-a6340df29f77 service swift] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.089260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc09f-a86c-469c-9d2b-a6340df29f77 service swift] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.155066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e2b7-a571-450e-80c3-3258295a8a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.155966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e2b7-a571-450e-80c3-3258295a8a28 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.156320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e2b7-a571-450e-80c3-3258295a8a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.156662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e2b7-a571-450e-80c3-3258295a8a28 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.157489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7e2b7-a571-450e-80c3-3258295a8a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.162467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7e2b7-a571-450e-80c3-3258295a8a28 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.191239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1080/2150] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:43 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:43.196129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eee2b-f434-4c40-8e31-e4c0c6f5560f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.218675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eee2b-f434-4c40-8e31-e4c0c6f5560f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.224735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5ba3-3282-40f0-9ad0-fe402b7dbba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.225398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5ba3-3282-40f0-9ad0-fe402b7dbba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.225669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5ba3-3282-40f0-9ad0-fe402b7dbba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.225939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5ba3-3282-40f0-9ad0-fe402b7dbba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.226657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a5ba3-3282-40f0-9ad0-fe402b7dbba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.228297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a5ba3-3282-40f0-9ad0-fe402b7dbba8 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.244445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1071/2151] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:43.245616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e2b7-a571-450e-80c3-3258295a8a28 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.258166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e2b7-a571-450e-80c3-3258295a8a28 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.263224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1db12-5a1f-4135-aba3-164151ef264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.263926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1db12-5a1f-4135-aba3-164151ef264e admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.264202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1db12-5a1f-4135-aba3-164151ef264e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.264475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1db12-5a1f-4135-aba3-164151ef264e admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.265197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1db12-5a1f-4135-aba3-164151ef264e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.266778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1db12-5a1f-4135-aba3-164151ef264e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.282999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1081/2152] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:43.284258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5ba3-3282-40f0-9ad0-fe402b7dbba8 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.296498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5ba3-3282-40f0-9ad0-fe402b7dbba8 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.301787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1882c-049b-4dc8-b39f-a54cc1540ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.303430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1882c-049b-4dc8-b39f-a54cc1540ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.303788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1882c-049b-4dc8-b39f-a54cc1540ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.304133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1882c-049b-4dc8-b39f-a54cc1540ddf admin admin] PATH_INFO: `/v3/projects/61806f9fa0214084aaa2ab14bc864cf4/users/f8a014714a834ea2a7813188d92a2465/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.320716 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1882c-049b-4dc8-b39f-a54cc1540ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=61806f9fa0214084aaa2ab14bc864cf4, user_id=f8a014714a834ea2a7813188d92a2465, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.324512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1882c-049b-4dc8-b39f-a54cc1540ddf admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.338987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1072/2153] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:43 2022] PUT /identity/v3/projects/61806f9fa0214084aaa2ab14bc864cf4/users/f8a014714a834ea2a7813188d92a2465/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:43.352942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70595ac-1a15-4e84-bc79-e4447dc139d4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.353548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70595ac-1a15-4e84-bc79-e4447dc139d4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.354647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70595ac-1a15-4e84-bc79-e4447dc139d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.403755 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c70595ac-1a15-4e84-bc79-e4447dc139d4 None None] MFA Rules not processed for user `f8a014714a834ea2a7813188d92a2465`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:43.405271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c70595ac-1a15-4e84-bc79-e4447dc139d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:43.498148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1082/2154] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:43.502270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1882c-049b-4dc8-b39f-a54cc1540ddf admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.667374 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1882c-049b-4dc8-b39f-a54cc1540ddf admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.685198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14711a4-09b0-46d4-a4a1-f727a1d46d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.685876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14711a4-09b0-46d4-a4a1-f727a1d46d86 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.686153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14711a4-09b0-46d4-a4a1-f727a1d46d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.686423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14711a4-09b0-46d4-a4a1-f727a1d46d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.687131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14711a4-09b0-46d4-a4a1-f727a1d46d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.691419 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14711a4-09b0-46d4-a4a1-f727a1d46d86 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.743260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1073/2155] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:43 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:43.747544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70595ac-1a15-4e84-bc79-e4447dc139d4 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.771791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70595ac-1a15-4e84-bc79-e4447dc139d4 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.910952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cd980-a784-4e2c-98e2-4915a29b56c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.911786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cd980-a784-4e2c-98e2-4915a29b56c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.912014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cd980-a784-4e2c-98e2-4915a29b56c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.912185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cd980-a784-4e2c-98e2-4915a29b56c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.912882 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cd980-a784-4e2c-98e2-4915a29b56c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.914984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cd980-a784-4e2c-98e2-4915a29b56c6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.944961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1083/2156] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:43 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:43.948561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14711a4-09b0-46d4-a4a1-f727a1d46d86 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.963932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14711a4-09b0-46d4-a4a1-f727a1d46d86 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:43.971485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47880a9-ec4b-4677-b625-655d8cce36f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:43.972564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47880a9-ec4b-4677-b625-655d8cce36f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:43.972871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47880a9-ec4b-4677-b625-655d8cce36f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:43.973330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47880a9-ec4b-4677-b625-655d8cce36f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:43.973952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47880a9-ec4b-4677-b625-655d8cce36f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:43.975660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47880a9-ec4b-4677-b625-655d8cce36f5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:43.992690 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cd980-a784-4e2c-98e2-4915a29b56c6 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:43.993193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1074/2157] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:44.005098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cd980-a784-4e2c-98e2-4915a29b56c6 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:44.010968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aea3fb-6b8f-4984-8743-a618606be46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:44.012079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea3fb-6b8f-4984-8743-a618606be46c admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:44.012424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea3fb-6b8f-4984-8743-a618606be46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:44.012813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea3fb-6b8f-4984-8743-a618606be46c admin admin] PATH_INFO: `/v3/projects/b6a948a994514475a9446c5a42ec2ed8/users/6e9932de64ab44d39ea1edfae115917a/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:44.035146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aea3fb-6b8f-4984-8743-a618606be46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a948a994514475a9446c5a42ec2ed8, user_id=6e9932de64ab44d39ea1edfae115917a, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:44.038407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aea3fb-6b8f-4984-8743-a618606be46c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:44.064498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1084/2158] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:43 2022] PUT /identity/v3/projects/b6a948a994514475a9446c5a42ec2ed8/users/6e9932de64ab44d39ea1edfae115917a/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:44.066243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47880a9-ec4b-4677-b625-655d8cce36f5 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:44.089586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47880a9-ec4b-4677-b625-655d8cce36f5 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:44.216003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07de20f-8910-4751-83a6-1fd85467abab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:44.218687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de20f-8910-4751-83a6-1fd85467abab admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:44.219051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de20f-8910-4751-83a6-1fd85467abab admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:44.219430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de20f-8910-4751-83a6-1fd85467abab admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:44.221056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07de20f-8910-4751-83a6-1fd85467abab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:44.223496 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07de20f-8910-4751-83a6-1fd85467abab admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:44.247579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1075/2159] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:44.251565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aea3fb-6b8f-4984-8743-a618606be46c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:44.266314 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aea3fb-6b8f-4984-8743-a618606be46c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:44.276686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:44.277920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:44.278267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:44.278614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] PATH_INFO: `/v3/projects/b6a948a994514475a9446c5a42ec2ed8/users/6e9932de64ab44d39ea1edfae115917a/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:44.281086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a948a994514475a9446c5a42ec2ed8, user_id=6e9932de64ab44d39ea1edfae115917a, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:44.283660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:44.310513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1085/2160] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:44 2022] PUT /identity/v3/projects/b6a948a994514475a9446c5a42ec2ed8/users/6e9932de64ab44d39ea1edfae115917a/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:44.320744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286b0d-c3be-4535-8cd7-293471025c67 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:44.321119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286b0d-c3be-4535-8cd7-293471025c67 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:44.321693 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286b0d-c3be-4535-8cd7-293471025c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:44.359968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-e3286b0d-c3be-4535-8cd7-293471025c67 None None] MFA Rules not processed for user `6e9932de64ab44d39ea1edfae115917a`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:44.361333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e3286b0d-c3be-4535-8cd7-293471025c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:44.488699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1076/2161] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:44.497728 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:44.499677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:44.582464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ea8e5-cf10-4397-96ce-d9eb531cc1eb admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:44.587105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5da09a-698a-4633-b2f8-72836625c741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:44.587795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da09a-698a-4633-b2f8-72836625c741 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:44.588073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da09a-698a-4633-b2f8-72836625c741 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:44.588346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5da09a-698a-4633-b2f8-72836625c741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:44.599205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5da09a-698a-4633-b2f8-72836625c741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:44.600935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5da09a-698a-4633-b2f8-72836625c741 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:44.621646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1086/2162] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:44.705083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3286b0d-c3be-4535-8cd7-293471025c67 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:44.728345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3286b0d-c3be-4535-8cd7-293471025c67 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:44.734061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e2976-9b7f-4b09-87f2-5a82fc471294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:44.736467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e2976-9b7f-4b09-87f2-5a82fc471294 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:44.736832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e2976-9b7f-4b09-87f2-5a82fc471294 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:44.737177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e2976-9b7f-4b09-87f2-5a82fc471294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:44.809506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e2976-9b7f-4b09-87f2-5a82fc471294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:44.811075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e2976-9b7f-4b09-87f2-5a82fc471294 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:44.826736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1077/2163] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:48.553428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5da09a-698a-4633-b2f8-72836625c741 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:48.749589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5da09a-698a-4633-b2f8-72836625c741 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:48.765568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:48.767975 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:48.769609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:48.769609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] PATH_INFO: `/v3/users/f8a014714a834ea2a7813188d92a2465` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:48.772064 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a014714a834ea2a7813188d92a2465)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:48.776760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:48.886933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a014714a834ea2a7813188d92a2465'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:48.904588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a014714a834ea2a7813188d92a2465'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:48.936482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a014714a834ea2a7813188d92a2465'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:48.938436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a014714a834ea2a7813188d92a2465'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:48.989338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-46bb8dab-7f49-4d97-9e75-257773995904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a014714a834ea2a7813188d92a2465'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:49.004452 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1087/2164] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:48 2022] DELETE /identity/v3/users/f8a014714a834ea2a7813188d92a2465 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:49.013806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bf7d6-32e4-425e-8df4-e05a104a29df None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:49.014620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bf7d6-32e4-425e-8df4-e05a104a29df None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:49.015049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bf7d6-32e4-425e-8df4-e05a104a29df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:49.068851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5c30-d643-4fe1-abce-0f1a6235b077 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:49.069660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5c30-d643-4fe1-abce-0f1a6235b077 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:49.070086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5c30-d643-4fe1-abce-0f1a6235b077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:49.075486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-c35bf7d6-32e4-425e-8df4-e05a104a29df None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:49.077901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c35bf7d6-32e4-425e-8df4-e05a104a29df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:49.094260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-1a0d5c30-d643-4fe1-abce-0f1a6235b077 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:49.095814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1a0d5c30-d643-4fe1-abce-0f1a6235b077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:49.204269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1078/2165] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:49.216335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1088/2166] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 18:59:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:49.230134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bf7d6-32e4-425e-8df4-e05a104a29df None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:49.242874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c35bf7d6-32e4-425e-8df4-e05a104a29df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:49.247495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d5c30-d643-4fe1-abce-0f1a6235b077 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:49.248927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1a0d5c30-d643-4fe1-abce-0f1a6235b077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:49.426104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d5c30-d643-4fe1-abce-0f1a6235b077 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:49.431506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:49.432788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:49.433134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:49.433573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:49.445734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bf7d6-32e4-425e-8df4-e05a104a29df None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:49.452305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2639f8-1881-45f9-a275-5ca29bfe0a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:49.452965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2639f8-1881-45f9-a275-5ca29bfe0a1b service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:49.453241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2639f8-1881-45f9-a275-5ca29bfe0a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:49.453628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2639f8-1881-45f9-a275-5ca29bfe0a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:49.455489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:49.460881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:49.465069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2639f8-1881-45f9-a275-5ca29bfe0a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:49.471139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2639f8-1881-45f9-a275-5ca29bfe0a1b service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:49.476129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1089/2167] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 18:59:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 18:59:49.487015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1079/2168] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:50.239624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:50.241295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:50.315608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb836185-37c2-4872-8591-54865d29ddd6 service swift] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:50.329092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:50.330644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:50.330972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:50.331254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] PATH_INFO: `/v3/projects/61806f9fa0214084aaa2ab14bc864cf4` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:50.333599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61806f9fa0214084aaa2ab14bc864cf4)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:50.345129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:50.517631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61806f9fa0214084aaa2ab14bc864cf4', 'request_id': 'req-f2450c57-7709-4d31-bbc9-af3953eeb3c8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.564138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61806f9fa0214084aaa2ab14bc864cf4', 'request_id': 'req-f2450c57-7709-4d31-bbc9-af3953eeb3c8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.583141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61806f9fa0214084aaa2ab14bc864cf4', 'request_id': 'req-f2450c57-7709-4d31-bbc9-af3953eeb3c8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.625009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] The token cache is being invalidate because project 61806f9fa0214084aaa2ab14bc864cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:50.625686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.628966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-f2450c57-7709-4d31-bbc9-af3953eeb3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.635402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1090/2169] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:50 2022] DELETE /identity/v3/projects/61806f9fa0214084aaa2ab14bc864cf4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:50.636381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2639f8-1881-45f9-a275-5ca29bfe0a1b service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:50.650869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2639f8-1881-45f9-a275-5ca29bfe0a1b service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:50.768822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:50.770548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:50.771321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:50.772229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] PATH_INFO: `/v3/users/6e9932de64ab44d39ea1edfae115917a` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:50.775190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9932de64ab44d39ea1edfae115917a)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:50.778202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:50.908686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9932de64ab44d39ea1edfae115917a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.924210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9932de64ab44d39ea1edfae115917a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.925147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9932de64ab44d39ea1edfae115917a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.942955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9932de64ab44d39ea1edfae115917a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.944383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9932de64ab44d39ea1edfae115917a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:50.983144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1080/2170] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 18:59:50 2022] DELETE /identity/v3/users/6e9932de64ab44d39ea1edfae115917a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 18:59:51.510506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1703ec-d7de-45b7-a64b-1d793d5988fb None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:51.510991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1703ec-d7de-45b7-a64b-1d793d5988fb None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:51.510991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1703ec-d7de-45b7-a64b-1d793d5988fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:51.524659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:51.526732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:51.584939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-bc1703ec-d7de-45b7-a64b-1d793d5988fb None None] MFA Rules not processed for user `c9d83909ea2943f5834778a2a9aa1485`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:51.586508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-bc1703ec-d7de-45b7-a64b-1d793d5988fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:51.683619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ca6ce-960b-46f1-97ba-0f4c48f12b8f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:51.695700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:51.696846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:51.697268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:51.697691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] PATH_INFO: `/v3/projects/b6a948a994514475a9446c5a42ec2ed8` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:51.699775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a948a994514475a9446c5a42ec2ed8)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:51.702247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:51.767808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1091/2171] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:51.809523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a948a994514475a9446c5a42ec2ed8', 'request_id': 'req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:51.816671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a948a994514475a9446c5a42ec2ed8', 'request_id': 'req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:51.833051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a948a994514475a9446c5a42ec2ed8', 'request_id': 'req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:51.856231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] The token cache is being invalidate because project b6a948a994514475a9446c5a42ec2ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 18:59:51.856594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:51.859403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5a605026-dd5e-47c3-9110-bd5bdcc95c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 18:59:51.866921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1081/2172] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 18:59:51 2022] DELETE /identity/v3/projects/b6a948a994514475a9446c5a42ec2ed8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:51.868638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ef552-e7b4-42c8-8503-1c42e15162ac None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:51.868942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ef552-e7b4-42c8-8503-1c42e15162ac None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:51.869301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ef552-e7b4-42c8-8503-1c42e15162ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:51.908523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e04ef552-e7b4-42c8-8503-1c42e15162ac None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:51.909741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e04ef552-e7b4-42c8-8503-1c42e15162ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:52.035326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1092/2173] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:52.043679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307934e-d246-4315-9b0a-45a218315d5b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.044332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307934e-d246-4315-9b0a-45a218315d5b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.044771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307934e-d246-4315-9b0a-45a218315d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.081419 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9307934e-d246-4315-9b0a-45a218315d5b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:52.082941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9307934e-d246-4315-9b0a-45a218315d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:52.094297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1082/2174] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:52.099924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ef552-e7b4-42c8-8503-1c42e15162ac None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:52.114683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ef552-e7b4-42c8-8503-1c42e15162ac None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:52.138107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:52.140701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.141148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.141942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.156178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 18:59:52.156682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:52.160822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:52.225174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1093/2175] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 18:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 18:59:52.229982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307934e-d246-4315-9b0a-45a218315d5b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:52.247412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307934e-d246-4315-9b0a-45a218315d5b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:52.259060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc335-bc18-4b58-bac8-48f2bab5836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:52.260488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc335-bc18-4b58-bac8-48f2bab5836c admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.261330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc335-bc18-4b58-bac8-48f2bab5836c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.261992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc335-bc18-4b58-bac8-48f2bab5836c admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.263391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcc335-bc18-4b58-bac8-48f2bab5836c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:52.266148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcc335-bc18-4b58-bac8-48f2bab5836c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:52.326544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1083/2176] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:52 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:52.327812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:52.339273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a64aec-9d70-4d96-95fb-1c74c45103cb admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:52.409433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523f62-c327-4afa-a981-21b911652600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:52.410168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523f62-c327-4afa-a981-21b911652600 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.410442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523f62-c327-4afa-a981-21b911652600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.410710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523f62-c327-4afa-a981-21b911652600 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.411478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49523f62-c327-4afa-a981-21b911652600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:52.413590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49523f62-c327-4afa-a981-21b911652600 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:52.438746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1094/2177] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:52 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 18:59:52.443159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc335-bc18-4b58-bac8-48f2bab5836c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:52.460974 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc335-bc18-4b58-bac8-48f2bab5836c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:52.473338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ae700-6598-4026-bbfd-e52c2a1a595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:52.473338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ae700-6598-4026-bbfd-e52c2a1a595f admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.473338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ae700-6598-4026-bbfd-e52c2a1a595f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.473338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ae700-6598-4026-bbfd-e52c2a1a595f admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.476780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ae700-6598-4026-bbfd-e52c2a1a595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:52.476780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ae700-6598-4026-bbfd-e52c2a1a595f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:52.494779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1084/2178] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:52.498321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523f62-c327-4afa-a981-21b911652600 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:52.509554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523f62-c327-4afa-a981-21b911652600 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:52.516002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef42a3d-c4bd-451c-a4de-f8a1d3839368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:52.516898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef42a3d-c4bd-451c-a4de-f8a1d3839368 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.517507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef42a3d-c4bd-451c-a4de-f8a1d3839368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.517976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef42a3d-c4bd-451c-a4de-f8a1d3839368 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.519122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef42a3d-c4bd-451c-a4de-f8a1d3839368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:52.521421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef42a3d-c4bd-451c-a4de-f8a1d3839368 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:52.537322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1095/2179] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:52.538274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ae700-6598-4026-bbfd-e52c2a1a595f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:52.552803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ae700-6598-4026-bbfd-e52c2a1a595f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:52.566975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:52.568139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.568556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.568909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] PATH_INFO: `/v3/projects/d85e1c26b1394d4c9af2d5eed48946f5/users/865f1ad544d54c85b899d77bc3f4b87a/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.586036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85e1c26b1394d4c9af2d5eed48946f5, user_id=865f1ad544d54c85b899d77bc3f4b87a, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:52.593273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:52.616822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1085/2180] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:52 2022] PUT /identity/v3/projects/d85e1c26b1394d4c9af2d5eed48946f5/users/865f1ad544d54c85b899d77bc3f4b87a/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:52.622015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a995c-9e61-484b-9c3f-a73ee8051ba1 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.622506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a995c-9e61-484b-9c3f-a73ee8051ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.622974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a995c-9e61-484b-9c3f-a73ee8051ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.656361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-077a995c-9e61-484b-9c3f-a73ee8051ba1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:52.658780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-077a995c-9e61-484b-9c3f-a73ee8051ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:52.795676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1096/2181] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:52.805128 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:52.807234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:52.888872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f4377-2390-4787-9d6e-761a6be1d9dc admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:52.901397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc1068-708f-4f4f-aaeb-7e385f6dfac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:52.902067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc1068-708f-4f4f-aaeb-7e385f6dfac1 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:52.902350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc1068-708f-4f4f-aaeb-7e385f6dfac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:52.902619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc1068-708f-4f4f-aaeb-7e385f6dfac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:52.926155 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc1068-708f-4f4f-aaeb-7e385f6dfac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:52.929731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc1068-708f-4f4f-aaeb-7e385f6dfac1 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:52.948548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1086/2182] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:54.313552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc499c-2e29-48b6-9dab-b947747612ee None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:54.314106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc499c-2e29-48b6-9dab-b947747612ee None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:54.314106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc499c-2e29-48b6-9dab-b947747612ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:54.378033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-08cc499c-2e29-48b6-9dab-b947747612ee None None] MFA Rules not processed for user `865f1ad544d54c85b899d77bc3f4b87a`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:54.379634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-08cc499c-2e29-48b6-9dab-b947747612ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:54.526762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1097/2183] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:54.536030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc1068-708f-4f4f-aaeb-7e385f6dfac1 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:54.574050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc1068-708f-4f4f-aaeb-7e385f6dfac1 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:54.602481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c57bb-d62e-4aa0-ba93-3e4b4688defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:54.603703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c57bb-d62e-4aa0-ba93-3e4b4688defa admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:54.604297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c57bb-d62e-4aa0-ba93-3e4b4688defa admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:54.604702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c57bb-d62e-4aa0-ba93-3e4b4688defa admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:54.607903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c57bb-d62e-4aa0-ba93-3e4b4688defa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:54.617800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c57bb-d62e-4aa0-ba93-3e4b4688defa admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:54.696492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1087/2184] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 18:59:54 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:54.701431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc499c-2e29-48b6-9dab-b947747612ee None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:54.724282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc499c-2e29-48b6-9dab-b947747612ee None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:54.853091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa8cfc-5a87-4ee4-b814-a90a1fd52f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:54.853399 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8cfc-5a87-4ee4-b814-a90a1fd52f4f admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:54.853521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8cfc-5a87-4ee4-b814-a90a1fd52f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:54.853771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8cfc-5a87-4ee4-b814-a90a1fd52f4f admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:54.854840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa8cfc-5a87-4ee4-b814-a90a1fd52f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:54.856425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa8cfc-5a87-4ee4-b814-a90a1fd52f4f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:54.888685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1098/2185] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 18:59:54 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 18:59:54.892759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c57bb-d62e-4aa0-ba93-3e4b4688defa admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:54.911260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c57bb-d62e-4aa0-ba93-3e4b4688defa admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:54.929078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac841a67-8115-4002-81c6-87d281c8fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:54.929756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac841a67-8115-4002-81c6-87d281c8fcbc admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:54.930038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac841a67-8115-4002-81c6-87d281c8fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:54.942106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac841a67-8115-4002-81c6-87d281c8fcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:54.942106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac841a67-8115-4002-81c6-87d281c8fcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:54.942106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac841a67-8115-4002-81c6-87d281c8fcbc admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:54.971124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1088/2186] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 18:59:54.975441 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa8cfc-5a87-4ee4-b814-a90a1fd52f4f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:54.989901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa8cfc-5a87-4ee4-b814-a90a1fd52f4f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:55.022385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9694d4a-8a19-4f73-85a4-d3f56b29f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:55.022385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694d4a-8a19-4f73-85a4-d3f56b29f601 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:55.022385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694d4a-8a19-4f73-85a4-d3f56b29f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:55.022385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694d4a-8a19-4f73-85a4-d3f56b29f601 admin admin] PATH_INFO: `/v3/projects/7283cc684cc24a48a573b55229d7fdd6/users/f6f3d7337ac34e1eba88e885a5f562ff/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:55.053524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9694d4a-8a19-4f73-85a4-d3f56b29f601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7283cc684cc24a48a573b55229d7fdd6, user_id=f6f3d7337ac34e1eba88e885a5f562ff, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:55.060820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9694d4a-8a19-4f73-85a4-d3f56b29f601 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:55.095850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac841a67-8115-4002-81c6-87d281c8fcbc admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:55.096251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1099/2187] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:54 2022] PUT /identity/v3/projects/7283cc684cc24a48a573b55229d7fdd6/users/f6f3d7337ac34e1eba88e885a5f562ff/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:55.114655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac841a67-8115-4002-81c6-87d281c8fcbc admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:55.194479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef280b8-e9be-46a2-b28c-5cb6f0d30339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:55.195224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef280b8-e9be-46a2-b28c-5cb6f0d30339 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:55.195596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef280b8-e9be-46a2-b28c-5cb6f0d30339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:55.195821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef280b8-e9be-46a2-b28c-5cb6f0d30339 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:55.196558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef280b8-e9be-46a2-b28c-5cb6f0d30339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:55.198194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef280b8-e9be-46a2-b28c-5cb6f0d30339 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:55.209868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1089/2188] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 18:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 18:59:55.214070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9694d4a-8a19-4f73-85a4-d3f56b29f601 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:55.225342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9694d4a-8a19-4f73-85a4-d3f56b29f601 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:55.230367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:55.231278 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:55.231730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:55.232013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] PATH_INFO: `/v3/projects/7283cc684cc24a48a573b55229d7fdd6/users/f6f3d7337ac34e1eba88e885a5f562ff/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:55.234261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7283cc684cc24a48a573b55229d7fdd6, user_id=f6f3d7337ac34e1eba88e885a5f562ff, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:55.237550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:55.256801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1100/2189] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 18:59:55 2022] PUT /identity/v3/projects/7283cc684cc24a48a573b55229d7fdd6/users/f6f3d7337ac34e1eba88e885a5f562ff/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 18:59:56.232598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0087e0-e7ac-45ff-a9c6-05f12a93bf4f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:56.233111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0087e0-e7ac-45ff-a9c6-05f12a93bf4f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:56.233366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0087e0-e7ac-45ff-a9c6-05f12a93bf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:56.317034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9e0087e0-e7ac-45ff-a9c6-05f12a93bf4f None None] MFA Rules not processed for user `f6f3d7337ac34e1eba88e885a5f562ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:56.318566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9e0087e0-e7ac-45ff-a9c6-05f12a93bf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:56.568837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1090/2190] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 18:59:56.577365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:56.579539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:56.789630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071aca4-d670-446d-8677-6f5b539c897a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:56.803810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714aea2-edba-405d-a368-ae1a15607b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:56.806154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714aea2-edba-405d-a368-ae1a15607b5c service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:56.806451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714aea2-edba-405d-a368-ae1a15607b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:56.806733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714aea2-edba-405d-a368-ae1a15607b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:56.846881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ff2e-4a50-4f04-81a5-223533b77a07 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:56.847217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ff2e-4a50-4f04-81a5-223533b77a07 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:56.847650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ff2e-4a50-4f04-81a5-223533b77a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:56.882252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b8d9ff2e-4a50-4f04-81a5-223533b77a07 None None] MFA Rules not processed for user `2558a8c34b324bc99b157b306c9cdf7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:56.883734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b8d9ff2e-4a50-4f04-81a5-223533b77a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:57.008658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714aea2-edba-405d-a368-ae1a15607b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:57.009340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1091/2191] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 18:59:57.011085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714aea2-edba-405d-a368-ae1a15607b5c service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:57.030939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1101/2192] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:58.605136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ff2e-4a50-4f04-81a5-223533b77a07 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 18:59:58.637960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ff2e-4a50-4f04-81a5-223533b77a07 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 18:59:58.651107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dd890-1280-4a76-8f92-17c18493154c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 18:59:58.652312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dd890-1280-4a76-8f92-17c18493154c service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:58.652743 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dd890-1280-4a76-8f92-17c18493154c service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:58.653181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dd890-1280-4a76-8f92-17c18493154c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:58.668414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dd890-1280-4a76-8f92-17c18493154c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 18:59:58.671002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dd890-1280-4a76-8f92-17c18493154c service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 18:59:58.688154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1092/2193] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 18:59:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 18:59:59.126601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbfe8c-635f-478c-8fd1-1113e6f3b949 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 18:59:59.127178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbfe8c-635f-478c-8fd1-1113e6f3b949 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 18:59:59.127393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbfe8c-635f-478c-8fd1-1113e6f3b949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 18:59:59.153343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b4fbfe8c-635f-478c-8fd1-1113e6f3b949 None None] MFA Rules not processed for user `f1f10686b4814794aadc34ec6194cc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 18:59:59.154971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b4fbfe8c-635f-478c-8fd1-1113e6f3b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 18:59:59.220335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1102/2194] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 18:59:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:00.949913 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a42ae-f9a5-4142-919f-473c9108bf25 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:00.950483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a42ae-f9a5-4142-919f-473c9108bf25 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:00.950590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a42ae-f9a5-4142-919f-473c9108bf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:00.998196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-230a42ae-f9a5-4142-919f-473c9108bf25 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:01.000095 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-230a42ae-f9a5-4142-919f-473c9108bf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:01.117505 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1093/2195] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 19:00:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:01.152350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbfe8c-635f-478c-8fd1-1113e6f3b949 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:01.154898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b4fbfe8c-635f-478c-8fd1-1113e6f3b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:01.328645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbfe8c-635f-478c-8fd1-1113e6f3b949 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:01.342790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca315fd-73d7-4981-83bd-e39b78e5e906 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:01.344113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca315fd-73d7-4981-83bd-e39b78e5e906 service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:01.344622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca315fd-73d7-4981-83bd-e39b78e5e906 service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:01.345104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca315fd-73d7-4981-83bd-e39b78e5e906 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:01.359937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca315fd-73d7-4981-83bd-e39b78e5e906 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:01.365444 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca315fd-73d7-4981-83bd-e39b78e5e906 service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:01.385006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1103/2196] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 19:00:18.817512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a42ae-f9a5-4142-919f-473c9108bf25 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:18.934560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a42ae-f9a5-4142-919f-473c9108bf25 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:18.946162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:18.947008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:18.947366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:18.947595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] PATH_INFO: `/v3/users/865f1ad544d54c85b899d77bc3f4b87a` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:18.953017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865f1ad544d54c85b899d77bc3f4b87a)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:18.955648 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:19.076110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865f1ad544d54c85b899d77bc3f4b87a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.087901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865f1ad544d54c85b899d77bc3f4b87a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.088670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865f1ad544d54c85b899d77bc3f4b87a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.096767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865f1ad544d54c85b899d77bc3f4b87a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.098388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d6109cc1-784e-4795-9284-9cde2ea5d8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865f1ad544d54c85b899d77bc3f4b87a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.144498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1094/2197] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:00:18 2022] DELETE /identity/v3/users/865f1ad544d54c85b899d77bc3f4b87a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:00:19.354183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca315fd-73d7-4981-83bd-e39b78e5e906 service swift] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:19.369060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca315fd-73d7-4981-83bd-e39b78e5e906 service swift] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:19.372778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5b83-f6bd-4f4a-b05b-ffc9499a354b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:19.373067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5b83-f6bd-4f4a-b05b-ffc9499a354b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:19.373340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5b83-f6bd-4f4a-b05b-ffc9499a354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:19.402464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7a0c5b83-f6bd-4f4a-b05b-ffc9499a354b None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:19.404432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7a0c5b83-f6bd-4f4a-b05b-ffc9499a354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:19.431963 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:19.433300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:19.433742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:19.434165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] PATH_INFO: `/v3/projects/d85e1c26b1394d4c9af2d5eed48946f5` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:19.435545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85e1c26b1394d4c9af2d5eed48946f5)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:19.437778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:19.496493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1095/2198] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 19:00:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:00:19.510756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c5b83-f6bd-4f4a-b05b-ffc9499a354b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:19.512576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7a0c5b83-f6bd-4f4a-b05b-ffc9499a354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:19.528270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85e1c26b1394d4c9af2d5eed48946f5', 'request_id': 'req-4e15a95a-d8a7-46ca-901e-821b8284c53e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.544480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85e1c26b1394d4c9af2d5eed48946f5', 'request_id': 'req-4e15a95a-d8a7-46ca-901e-821b8284c53e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.558991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85e1c26b1394d4c9af2d5eed48946f5', 'request_id': 'req-4e15a95a-d8a7-46ca-901e-821b8284c53e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.596297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] The token cache is being invalidate because project d85e1c26b1394d4c9af2d5eed48946f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:00:19.596673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.599798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.602057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1104/2199] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:00:19 2022] DELETE /identity/v3/projects/d85e1c26b1394d4c9af2d5eed48946f5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:00:19.607015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:19.608731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:19.669028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c5b83-f6bd-4f4a-b05b-ffc9499a354b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:19.728088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15a95a-d8a7-46ca-901e-821b8284c53e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:19.737743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:19.739740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:19.740483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:19.741112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] PATH_INFO: `/v3/users/f6f3d7337ac34e1eba88e885a5f562ff` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:19.743912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f3d7337ac34e1eba88e885a5f562ff)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:19.749317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:19.795154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:19.795887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:19.796174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:19.796472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:19.799595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:19.860503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f3d7337ac34e1eba88e885a5f562ff'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.881594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f3d7337ac34e1eba88e885a5f562ff'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.902389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:19.902389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:19.904766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f3d7337ac34e1eba88e885a5f562ff'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.905745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f3d7337ac34e1eba88e885a5f562ff'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.911818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1096/2200] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:00:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 19:00:19.932043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a7e37f6-146e-47ea-bb73-1b63416aceb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f3d7337ac34e1eba88e885a5f562ff'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:19.947946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1105/2201] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:00:19 2022] DELETE /identity/v3/users/f6f3d7337ac34e1eba88e885a5f562ff => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:00:20.342037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:20.362860 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5071d-7af2-4778-b7a5-391435c8e47f service swift] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:20.438660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:20.439579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.439858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.440134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] PATH_INFO: `/v3/projects/7283cc684cc24a48a573b55229d7fdd6` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.441342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7283cc684cc24a48a573b55229d7fdd6)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:20.441802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322729e-03b1-4452-991a-c48b41ff839d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.442261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322729e-03b1-4452-991a-c48b41ff839d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.442357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322729e-03b1-4452-991a-c48b41ff839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.443426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:20.461091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0322729e-03b1-4452-991a-c48b41ff839d None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:20.462398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0322729e-03b1-4452-991a-c48b41ff839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:20.492016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7283cc684cc24a48a573b55229d7fdd6', 'request_id': 'req-312392a3-8544-4925-a56f-059c9928099e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:20.498043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7283cc684cc24a48a573b55229d7fdd6', 'request_id': 'req-312392a3-8544-4925-a56f-059c9928099e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:20.505304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7283cc684cc24a48a573b55229d7fdd6', 'request_id': 'req-312392a3-8544-4925-a56f-059c9928099e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:20.517437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] The token cache is being invalidate because project 7283cc684cc24a48a573b55229d7fdd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:00:20.517732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:20.518407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-312392a3-8544-4925-a56f-059c9928099e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:20.519957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1097/2202] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:00:20 2022] DELETE /identity/v3/projects/7283cc684cc24a48a573b55229d7fdd6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:00:20.521636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1106/2203] 10.222.0.93 () {58 vars in 967 bytes} [Wed May 11 19:00:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:00:20.524588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2efe-dc7b-4a88-b2ee-dda8ca914a23 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.524788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2efe-dc7b-4a88-b2ee-dda8ca914a23 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.525067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2efe-dc7b-4a88-b2ee-dda8ca914a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.535010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322729e-03b1-4452-991a-c48b41ff839d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:20.536442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0322729e-03b1-4452-991a-c48b41ff839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:20.557594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a7fc2efe-dc7b-4a88-b2ee-dda8ca914a23 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:20.558746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a7fc2efe-dc7b-4a88-b2ee-dda8ca914a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:20.609345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322729e-03b1-4452-991a-c48b41ff839d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:20.616243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1098/2204] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:20.624745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b961365-9ad7-4017-9e9c-ec6b79aa8fcc None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.625030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b961365-9ad7-4017-9e9c-ec6b79aa8fcc None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.625307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b961365-9ad7-4017-9e9c-ec6b79aa8fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.644066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4b961365-9ad7-4017-9e9c-ec6b79aa8fcc None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:20.645317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4b961365-9ad7-4017-9e9c-ec6b79aa8fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:20.653335 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1099/2205] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:00:20.657135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b961365-9ad7-4017-9e9c-ec6b79aa8fcc None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:20.666792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b961365-9ad7-4017-9e9c-ec6b79aa8fcc None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:20.669063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:20.669710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.669984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.670250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.672147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:20.676809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:20.677914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.678420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.678922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.680328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:00:20.680940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:20.683049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:20.696663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1100/2206] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 19:00:20.701125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:20.712218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6188-fbbf-46e5-85a7-d4b4f0a186bf admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:20.716977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92106c83-d373-4d1b-84db-b657936a0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:20.717614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106c83-d373-4d1b-84db-b657936a0b49 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.717893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106c83-d373-4d1b-84db-b657936a0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.718166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106c83-d373-4d1b-84db-b657936a0b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.718844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92106c83-d373-4d1b-84db-b657936a0b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:20.721308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92106c83-d373-4d1b-84db-b657936a0b49 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:20.731877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:20.733474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:20.742514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1107/2207] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 19:00:20.746827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1101/2208] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:00:20 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:00:20.751105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:20.762786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8b1d-bb2e-4f1c-b5e5-65c9e86d1055 service swift] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:20.857068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819525e-d3db-424c-9146-749a3796b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:20.857760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819525e-d3db-424c-9146-749a3796b7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.858041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819525e-d3db-424c-9146-749a3796b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.858347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819525e-d3db-424c-9146-749a3796b7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.859011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819525e-d3db-424c-9146-749a3796b7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:20.862393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819525e-d3db-424c-9146-749a3796b7b4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:20.900074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1108/2209] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:00:20 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:00:20.904011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92106c83-d373-4d1b-84db-b657936a0b49 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:20.921535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92106c83-d373-4d1b-84db-b657936a0b49 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:20.928346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493890f9-36e0-4023-8de8-a1597ce582d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:20.929193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493890f9-36e0-4023-8de8-a1597ce582d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.929928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493890f9-36e0-4023-8de8-a1597ce582d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.929928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493890f9-36e0-4023-8de8-a1597ce582d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.930966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493890f9-36e0-4023-8de8-a1597ce582d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:20.932714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493890f9-36e0-4023-8de8-a1597ce582d5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:20.949551 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1102/2210] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:00:20.954186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819525e-d3db-424c-9146-749a3796b7b4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:20.967495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819525e-d3db-424c-9146-749a3796b7b4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:20.973563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f075df4-8182-44fc-8ac8-b33dae11070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:20.974433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f075df4-8182-44fc-8ac8-b33dae11070f admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:20.974723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f075df4-8182-44fc-8ac8-b33dae11070f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:20.975004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f075df4-8182-44fc-8ac8-b33dae11070f admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:20.975836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f075df4-8182-44fc-8ac8-b33dae11070f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:20.977449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f075df4-8182-44fc-8ac8-b33dae11070f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:20.991834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1109/2211] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:00:20.995764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493890f9-36e0-4023-8de8-a1597ce582d5 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:21.014602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493890f9-36e0-4023-8de8-a1597ce582d5 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:21.028233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:21.029588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:21.029964 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:21.030490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] PATH_INFO: `/v3/projects/b4f7e5d2482743a7b1017e7795f51088/users/1a0dc4b34c3b4538acf4828e9cba84e5/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:21.051050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f7e5d2482743a7b1017e7795f51088, user_id=1a0dc4b34c3b4538acf4828e9cba84e5, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:21.054071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:21.081101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1103/2212] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:00:20 2022] PUT /identity/v3/projects/b4f7e5d2482743a7b1017e7795f51088/users/1a0dc4b34c3b4538acf4828e9cba84e5/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:00:21.104405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939811c2-4789-45b8-9bd6-5c8f9fd6bc6c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:21.104405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939811c2-4789-45b8-9bd6-5c8f9fd6bc6c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:21.104405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939811c2-4789-45b8-9bd6-5c8f9fd6bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:21.130810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-939811c2-4789-45b8-9bd6-5c8f9fd6bc6c None None] MFA Rules not processed for user `1a0dc4b34c3b4538acf4828e9cba84e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:21.132977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-939811c2-4789-45b8-9bd6-5c8f9fd6bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:21.266144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1110/2213] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:00:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:21.495127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:21.497030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:21.659142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d880b-858d-4771-9bbf-8749b9ce8469 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:21.679419 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a3ed-cf10-4cc5-a9f5-52405956aea4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:21.682059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a3ed-cf10-4cc5-a9f5-52405956aea4 service glance] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:21.684059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a3ed-cf10-4cc5-a9f5-52405956aea4 service glance] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:21.684706 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a3ed-cf10-4cc5-a9f5-52405956aea4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:21.707835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a3ed-cf10-4cc5-a9f5-52405956aea4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:21.709280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a3ed-cf10-4cc5-a9f5-52405956aea4 service glance] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:21.724050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1104/2214] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:00:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:00:23.459125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939811c2-4789-45b8-9bd6-5c8f9fd6bc6c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:23.461362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-939811c2-4789-45b8-9bd6-5c8f9fd6bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:23.577905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939811c2-4789-45b8-9bd6-5c8f9fd6bc6c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:23.585558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:23.587650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:23.587935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:23.588210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] PATH_INFO: `/v3/users/04109028620d4b7284fbd32efc695c56` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:23.589631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04109028620d4b7284fbd32efc695c56)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:23.591598 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:23.667075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04109028620d4b7284fbd32efc695c56'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:23.675524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04109028620d4b7284fbd32efc695c56'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:23.688779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04109028620d4b7284fbd32efc695c56'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:23.690129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04109028620d4b7284fbd32efc695c56'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:23.702843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1fbd4f21-de8c-4264-85f7-745d353ca523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04109028620d4b7284fbd32efc695c56'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:23.709870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1111/2215] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:00:23 2022] DELETE /identity/v3/users/04109028620d4b7284fbd32efc695c56 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:00:24.132512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a3ed-cf10-4cc5-a9f5-52405956aea4 service glance] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:24.153998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a3ed-cf10-4cc5-a9f5-52405956aea4 service glance] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:24.276705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:24.277610 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:24.277885 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:24.278228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] PATH_INFO: `/v3/projects/335338c6d5e740d0b388702462e552ef` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:24.279504 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335338c6d5e740d0b388702462e552ef)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:24.281685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:24.353704 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335338c6d5e740d0b388702462e552ef', 'request_id': 'req-585f80f0-5349-4da4-8303-8fa84481e234'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:24.363164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335338c6d5e740d0b388702462e552ef', 'request_id': 'req-585f80f0-5349-4da4-8303-8fa84481e234'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:24.376761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335338c6d5e740d0b388702462e552ef', 'request_id': 'req-585f80f0-5349-4da4-8303-8fa84481e234'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:24.395798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] The token cache is being invalidate because project 335338c6d5e740d0b388702462e552ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:00:24.396243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:24.397103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-585f80f0-5349-4da4-8303-8fa84481e234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:00:24.402931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1105/2216] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:00:24 2022] DELETE /identity/v3/projects/335338c6d5e740d0b388702462e552ef => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:00:24.404848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886daf-a4cc-4f5e-867a-bc3ed9348944 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:24.405516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886daf-a4cc-4f5e-867a-bc3ed9348944 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:24.406005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886daf-a4cc-4f5e-867a-bc3ed9348944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:24.438028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-4b886daf-a4cc-4f5e-867a-bc3ed9348944 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:24.439884 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4b886daf-a4cc-4f5e-867a-bc3ed9348944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:24.514446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1112/2217] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:24.523044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bdfcb-e994-4d8c-9d93-8a948ee74aa5 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:24.523428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bdfcb-e994-4d8c-9d93-8a948ee74aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:24.523707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bdfcb-e994-4d8c-9d93-8a948ee74aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:24.546457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-8e9bdfcb-e994-4d8c-9d93-8a948ee74aa5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:24.547904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8e9bdfcb-e994-4d8c-9d93-8a948ee74aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:24.557122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1106/2218] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:24.561481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886daf-a4cc-4f5e-867a-bc3ed9348944 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:24.573189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886daf-a4cc-4f5e-867a-bc3ed9348944 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:24.583580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:24.584309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:24.584774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:24.585000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:24.585916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:00:24.586166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:24.587903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:24.601429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1113/2219] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:00:24.605752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bdfcb-e994-4d8c-9d93-8a948ee74aa5 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:24.617145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bdfcb-e994-4d8c-9d93-8a948ee74aa5 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:24.622322 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af29f5-e8e2-47d4-8194-010cd52d1b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:24.623130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af29f5-e8e2-47d4-8194-010cd52d1b2d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:24.623481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af29f5-e8e2-47d4-8194-010cd52d1b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:24.623751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af29f5-e8e2-47d4-8194-010cd52d1b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:24.624451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af29f5-e8e2-47d4-8194-010cd52d1b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:24.626436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af29f5-e8e2-47d4-8194-010cd52d1b2d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:24.653174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1107/2220] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:00:24 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:00:24.656749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:24.675515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489de28b-1b7e-4550-83ba-17a34af0c0ac admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:24.763202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae7df-a9de-4266-b854-a26d5b463676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:24.764302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae7df-a9de-4266-b854-a26d5b463676 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:24.765523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae7df-a9de-4266-b854-a26d5b463676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:24.766071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae7df-a9de-4266-b854-a26d5b463676 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:24.767338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ae7df-a9de-4266-b854-a26d5b463676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:24.770825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ae7df-a9de-4266-b854-a26d5b463676 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:24.801193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1114/2221] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:00:24 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:00:24.802487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af29f5-e8e2-47d4-8194-010cd52d1b2d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:24.817720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af29f5-e8e2-47d4-8194-010cd52d1b2d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:24.834194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e951ca-240b-4daa-a3a4-110510d59666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:24.834890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e951ca-240b-4daa-a3a4-110510d59666 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:24.835169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e951ca-240b-4daa-a3a4-110510d59666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:24.842535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e951ca-240b-4daa-a3a4-110510d59666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:24.845822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e951ca-240b-4daa-a3a4-110510d59666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:24.849260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e951ca-240b-4daa-a3a4-110510d59666 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:24.880228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1108/2222] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:00:24.886298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae7df-a9de-4266-b854-a26d5b463676 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:24.904270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae7df-a9de-4266-b854-a26d5b463676 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:24.920036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae836-86f0-408e-a671-c2e7924d2b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:24.920669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae836-86f0-408e-a671-c2e7924d2b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:24.920943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae836-86f0-408e-a671-c2e7924d2b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:24.921224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae836-86f0-408e-a671-c2e7924d2b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:24.922019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae836-86f0-408e-a671-c2e7924d2b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:24.923750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae836-86f0-408e-a671-c2e7924d2b39 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:24.977096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1115/2223] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:00:24.981717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e951ca-240b-4daa-a3a4-110510d59666 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:24.998600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e951ca-240b-4daa-a3a4-110510d59666 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:25.005408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:25.019378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:25.019730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:25.020021 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] PATH_INFO: `/v3/projects/f58837e3d1b34bb0a37896985a7129f8/users/ed0fbd1d4c114fbaa6ec771b8e2687bd/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:25.054900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58837e3d1b34bb0a37896985a7129f8, user_id=ed0fbd1d4c114fbaa6ec771b8e2687bd, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:25.096216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:25.234193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1109/2224] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:00:24 2022] PUT /identity/v3/projects/f58837e3d1b34bb0a37896985a7129f8/users/ed0fbd1d4c114fbaa6ec771b8e2687bd/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:00:25.246035 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e00e4d-f823-402b-ab91-8e23da30c8bd None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:25.246559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e00e4d-f823-402b-ab91-8e23da30c8bd None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:25.247083 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e00e4d-f823-402b-ab91-8e23da30c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:25.332398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-43e00e4d-f823-402b-ab91-8e23da30c8bd None None] MFA Rules not processed for user `ed0fbd1d4c114fbaa6ec771b8e2687bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:25.338890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-43e00e4d-f823-402b-ab91-8e23da30c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:25.496987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1116/2225] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:00:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:30.315282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:30.317139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:30.419545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565a0a-b232-4c88-8bc1-d71cc06934f3 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:30.423311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a0a87-98ee-42f6-8674-99231b6bafb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:30.423898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a0a87-98ee-42f6-8674-99231b6bafb4 service glance] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:30.424174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a0a87-98ee-42f6-8674-99231b6bafb4 service glance] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:30.424445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a0a87-98ee-42f6-8674-99231b6bafb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:30.432933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a0a87-98ee-42f6-8674-99231b6bafb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:30.434376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a0a87-98ee-42f6-8674-99231b6bafb4 service glance] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:30.443428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1110/2226] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:00:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:00:41.975251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e00e4d-f823-402b-ab91-8e23da30c8bd None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:41.977680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-43e00e4d-f823-402b-ab91-8e23da30c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:42.074059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e00e4d-f823-402b-ab91-8e23da30c8bd None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:42.079082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fee2e-056b-4277-84e4-f199dab1e0bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '911d21a666844fc399286e24c2892184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:42.079786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fee2e-056b-4277-84e4-f199dab1e0bb service placement] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:42.080067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fee2e-056b-4277-84e4-f199dab1e0bb service placement] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:42.080336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fee2e-056b-4277-84e4-f199dab1e0bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:42.082100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-368fee2e-056b-4277-84e4-f199dab1e0bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:42.093905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fee2e-056b-4277-84e4-f199dab1e0bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:42.096301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fee2e-056b-4277-84e4-f199dab1e0bb service placement] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:42.106758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1117/2227] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:00:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:00:44.270926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983994de-e8df-4c0b-9395-e851cc1715bf None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.271517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983994de-e8df-4c0b-9395-e851cc1715bf None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.272275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983994de-e8df-4c0b-9395-e851cc1715bf None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.274025 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1111/2228] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 19:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 19:00:44.280034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca7bf-4922-4486-ab99-b8035c1e9883 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.280531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca7bf-4922-4486-ab99-b8035c1e9883 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.280792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca7bf-4922-4486-ab99-b8035c1e9883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.340686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-714ca7bf-4922-4486-ab99-b8035c1e9883 None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:44.342019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-714ca7bf-4922-4486-ab99-b8035c1e9883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:44.420316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1118/2229] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 19:00:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:44.432357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983994de-e8df-4c0b-9395-e851cc1715bf None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:44.434014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-983994de-e8df-4c0b-9395-e851cc1715bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:44.447945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983994de-e8df-4c0b-9395-e851cc1715bf None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:44.451461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c094d-4d0e-46fb-837b-9f16d4dc37ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:44.452145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c094d-4d0e-46fb-837b-9f16d4dc37ef service glance] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.452420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c094d-4d0e-46fb-837b-9f16d4dc37ef service glance] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.452688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c094d-4d0e-46fb-837b-9f16d4dc37ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.462854 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c094d-4d0e-46fb-837b-9f16d4dc37ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:44.464298 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c094d-4d0e-46fb-837b-9f16d4dc37ef service glance] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:44.477231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1112/2230] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:00:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:00:44.545981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0629-f955-4873-b148-2602afe1cc06 None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.546268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0629-f955-4873-b148-2602afe1cc06 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.546548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0629-f955-4873-b148-2602afe1cc06 None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.548837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1119/2231] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 19:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 19:00:44.557476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4379d4-9b19-42c0-a4e8-579d822bbd56 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.557758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4379d4-9b19-42c0-a4e8-579d822bbd56 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.558027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4379d4-9b19-42c0-a4e8-579d822bbd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.585182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-8a4379d4-9b19-42c0-a4e8-579d822bbd56 None None] MFA Rules not processed for user `af0204b62913420a90303c42dbded7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:44.586426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8a4379d4-9b19-42c0-a4e8-579d822bbd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:44.644403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1113/2232] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 19:00:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:44.658635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0629-f955-4873-b148-2602afe1cc06 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:44.660446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-349d0629-f955-4873-b148-2602afe1cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:44.674572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0629-f955-4873-b148-2602afe1cc06 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:44.678297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6bf11-0a92-4abb-8383-90e188b5ccc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:44.678952 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6bf11-0a92-4abb-8383-90e188b5ccc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.679283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6bf11-0a92-4abb-8383-90e188b5ccc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.679609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6bf11-0a92-4abb-8383-90e188b5ccc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.686715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6bf11-0a92-4abb-8383-90e188b5ccc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:44.688187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6bf11-0a92-4abb-8383-90e188b5ccc8 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:44.696130 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1120/2233] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:00:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:00:44.790175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544bf60-4c11-4937-9418-9a14c13f2189 None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.790460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544bf60-4c11-4937-9418-9a14c13f2189 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.790744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544bf60-4c11-4937-9418-9a14c13f2189 None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.792588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1114/2234] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 19:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 19:00:44.797947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d315ab-a7f1-40c0-8fd9-e17e8c95c666 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.798231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d315ab-a7f1-40c0-8fd9-e17e8c95c666 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.798503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d315ab-a7f1-40c0-8fd9-e17e8c95c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.819835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e2d315ab-a7f1-40c0-8fd9-e17e8c95c666 None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:44.821045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e2d315ab-a7f1-40c0-8fd9-e17e8c95c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:44.830905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1121/2235] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 19:00:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:44.841336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544bf60-4c11-4937-9418-9a14c13f2189 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:44.843121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1544bf60-4c11-4937-9418-9a14c13f2189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:44.856812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544bf60-4c11-4937-9418-9a14c13f2189 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:44.860325 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706a13-60ae-4b63-8d8e-f9fa47b310bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:44.860972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706a13-60ae-4b63-8d8e-f9fa47b310bc service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:44.861250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706a13-60ae-4b63-8d8e-f9fa47b310bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:44.861527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706a13-60ae-4b63-8d8e-f9fa47b310bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:44.872052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d706a13-60ae-4b63-8d8e-f9fa47b310bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:44.873671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d706a13-60ae-4b63-8d8e-f9fa47b310bc service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:44.885611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1115/2236] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:00:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:00:46.008245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d315ab-a7f1-40c0-8fd9-e17e8c95c666 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:46.018449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d315ab-a7f1-40c0-8fd9-e17e8c95c666 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:46.023183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:46.023183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:46.023183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:46.023516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:46.025287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:46.093262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:46.094739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:46.105828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1122/2237] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:00:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:00:58.276909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94553-f8cf-477a-90c3-b0165ebcd678 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:58.277413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94553-f8cf-477a-90c3-b0165ebcd678 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:58.277509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94553-f8cf-477a-90c3-b0165ebcd678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:58.331182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-39f94553-f8cf-477a-90c3-b0165ebcd678 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:00:58.332433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-39f94553-f8cf-477a-90c3-b0165ebcd678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:58.396583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1116/2238] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 19:00:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:00:58.409200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:00:58.410630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:00:58.513332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6835a-f5ee-4157-897d-2fc11d53a9cb service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:00:58.519033 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585c85f-575b-4c17-b18d-8f471d77091d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:00:58.519702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585c85f-575b-4c17-b18d-8f471d77091d service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:00:58.519984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585c85f-575b-4c17-b18d-8f471d77091d service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:00:58.520260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585c85f-575b-4c17-b18d-8f471d77091d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:00:58.528183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585c85f-575b-4c17-b18d-8f471d77091d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:00:58.529766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585c85f-575b-4c17-b18d-8f471d77091d service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:00:58.537858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1123/2239] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:00:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 19:01:08.174362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f94553-f8cf-477a-90c3-b0165ebcd678 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:08.175824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-39f94553-f8cf-477a-90c3-b0165ebcd678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:08.276320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f94553-f8cf-477a-90c3-b0165ebcd678 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:08.280853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:08.281718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:08.281991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:08.282256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] PATH_INFO: `/v3/users/1a0dc4b34c3b4538acf4828e9cba84e5` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:08.283957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0dc4b34c3b4538acf4828e9cba84e5)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:08.285859 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:08.340199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0dc4b34c3b4538acf4828e9cba84e5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:08.347446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0dc4b34c3b4538acf4828e9cba84e5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:08.348099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0dc4b34c3b4538acf4828e9cba84e5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:08.355112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0dc4b34c3b4538acf4828e9cba84e5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:08.355733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0dc4b34c3b4538acf4828e9cba84e5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:08.373125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1117/2240] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:01:08 2022] DELETE /identity/v3/users/1a0dc4b34c3b4538acf4828e9cba84e5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:08.377468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7e7f-b314-42d5-a2d6-931d0cb7cdd6 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:08.377985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7e7f-b314-42d5-a2d6-931d0cb7cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:08.378158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7e7f-b314-42d5-a2d6-931d0cb7cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:08.396254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-6c2e7e7f-b314-42d5-a2d6-931d0cb7cdd6 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:08.397810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6c2e7e7f-b314-42d5-a2d6-931d0cb7cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:08.462681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1124/2241] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:08.472618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:08.474187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:08.538020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab54d2e-f1cb-46ba-ad04-c8e3c0096f9f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:08.541973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ef114-542e-4586-9955-7ebd1470f5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:08.542585 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef114-542e-4586-9955-7ebd1470f5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:08.542867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef114-542e-4586-9955-7ebd1470f5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:08.543138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef114-542e-4586-9955-7ebd1470f5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:08.554657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ef114-542e-4586-9955-7ebd1470f5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:08.556206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ef114-542e-4586-9955-7ebd1470f5a6 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:08.567350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1118/2242] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:01:08.881376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e7e7f-b314-42d5-a2d6-931d0cb7cdd6 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:08.882833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6c2e7e7f-b314-42d5-a2d6-931d0cb7cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:08.904656 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e7e7f-b314-42d5-a2d6-931d0cb7cdd6 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:08.913027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:08.913921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:08.914204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:08.914481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] PATH_INFO: `/v3/projects/b4f7e5d2482743a7b1017e7795f51088` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:08.917134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f7e5d2482743a7b1017e7795f51088)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:08.919383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:08.996740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f7e5d2482743a7b1017e7795f51088', 'request_id': 'req-0f18ad08-47f9-4958-96c6-cf56673e7cb3'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:09.008141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f7e5d2482743a7b1017e7795f51088', 'request_id': 'req-0f18ad08-47f9-4958-96c6-cf56673e7cb3'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:09.016492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f7e5d2482743a7b1017e7795f51088', 'request_id': 'req-0f18ad08-47f9-4958-96c6-cf56673e7cb3'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:09.029014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] The token cache is being invalidate because project b4f7e5d2482743a7b1017e7795f51088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:01:09.029321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:09.030085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f18ad08-47f9-4958-96c6-cf56673e7cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:09.034492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1125/2243] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:01:08 2022] DELETE /identity/v3/projects/b4f7e5d2482743a7b1017e7795f51088 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:09.039230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2c23-ab63-43c5-a4ab-18f26dd74f49 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.039570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2c23-ab63-43c5-a4ab-18f26dd74f49 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.039849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2c23-ab63-43c5-a4ab-18f26dd74f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.060898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-213b2c23-ab63-43c5-a4ab-18f26dd74f49 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:09.061570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-213b2c23-ab63-43c5-a4ab-18f26dd74f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:09.148013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1119/2244] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:09.157482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2b0c-528e-4e26-bcdc-ab2b10e349b8 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.157760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2b0c-528e-4e26-bcdc-ab2b10e349b8 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.158125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2b0c-528e-4e26-bcdc-ab2b10e349b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.181902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-35bc2b0c-528e-4e26-bcdc-ab2b10e349b8 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:09.183334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-35bc2b0c-528e-4e26-bcdc-ab2b10e349b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:09.201640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1126/2245] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:09.202185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b2c23-ab63-43c5-a4ab-18f26dd74f49 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:09.213273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b2c23-ab63-43c5-a4ab-18f26dd74f49 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:09.217682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:09.218351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.218630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.218901 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.220389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:01:09.220902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:09.222753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:09.240662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2b0c-528e-4e26-bcdc-ab2b10e349b8 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:09.246359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1120/2246] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 19:01:09.250862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2b0c-528e-4e26-bcdc-ab2b10e349b8 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:09.255729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee50e0-f974-46a9-831f-180fa1fd6b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:09.256529 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee50e0-f974-46a9-831f-180fa1fd6b7e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.256815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee50e0-f974-46a9-831f-180fa1fd6b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.257096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee50e0-f974-46a9-831f-180fa1fd6b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.257767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee50e0-f974-46a9-831f-180fa1fd6b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:09.259711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee50e0-f974-46a9-831f-180fa1fd6b7e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:09.303943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1127/2247] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:01:09 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:01:09.308140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:09.318482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5dccc-65f3-44eb-9cbe-7899bddaf5f5 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:09.396225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e773b2-e280-43d7-bfd7-a8eca6e49274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:09.396993 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e773b2-e280-43d7-bfd7-a8eca6e49274 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.397346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e773b2-e280-43d7-bfd7-a8eca6e49274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.397742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e773b2-e280-43d7-bfd7-a8eca6e49274 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.398562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e773b2-e280-43d7-bfd7-a8eca6e49274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:09.400624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e773b2-e280-43d7-bfd7-a8eca6e49274 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:09.427422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1121/2248] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:01:09 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:01:09.430931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee50e0-f974-46a9-831f-180fa1fd6b7e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:09.443886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee50e0-f974-46a9-831f-180fa1fd6b7e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:09.450011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddf784-c47a-411e-be72-f258a1ec5733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:09.451006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf784-c47a-411e-be72-f258a1ec5733 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.451487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf784-c47a-411e-be72-f258a1ec5733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.451995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf784-c47a-411e-be72-f258a1ec5733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.452972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddf784-c47a-411e-be72-f258a1ec5733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:09.455147 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddf784-c47a-411e-be72-f258a1ec5733 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:09.467084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1128/2249] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:01:09.471827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e773b2-e280-43d7-bfd7-a8eca6e49274 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:09.482807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e773b2-e280-43d7-bfd7-a8eca6e49274 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:09.487776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8f1f1-ce24-407a-b595-3a15db52f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:09.488703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8f1f1-ce24-407a-b595-3a15db52f5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.489088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8f1f1-ce24-407a-b595-3a15db52f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.489563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8f1f1-ce24-407a-b595-3a15db52f5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.490398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8f1f1-ce24-407a-b595-3a15db52f5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:09.492282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8f1f1-ce24-407a-b595-3a15db52f5a1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:09.507646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1122/2250] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:01:09.508887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddf784-c47a-411e-be72-f258a1ec5733 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:09.520748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddf784-c47a-411e-be72-f258a1ec5733 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:09.525460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:09.526345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.526658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.526934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] PATH_INFO: `/v3/projects/815644b884384ef79997746af0c5e7bb/users/20e6e60e8b8240b28c66913907beead4/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.545429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815644b884384ef79997746af0c5e7bb, user_id=20e6e60e8b8240b28c66913907beead4, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:09.548310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:09.573649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1129/2251] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:01:09 2022] PUT /identity/v3/projects/815644b884384ef79997746af0c5e7bb/users/20e6e60e8b8240b28c66913907beead4/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:09.582369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455444e6-b209-43e1-9ccd-d7dcb84ee15b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.582656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455444e6-b209-43e1-9ccd-d7dcb84ee15b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.582927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455444e6-b209-43e1-9ccd-d7dcb84ee15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.608872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-455444e6-b209-43e1-9ccd-d7dcb84ee15b None None] MFA Rules not processed for user `20e6e60e8b8240b28c66913907beead4`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:09.610098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-455444e6-b209-43e1-9ccd-d7dcb84ee15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:09.689026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1123/2252] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:09.700660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:09.702436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:09.789862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573c19-cf56-4386-8854-86ddfd181016 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:09.793654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200985-1414-4c1b-963f-aa8681cabeba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:09.794300 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200985-1414-4c1b-963f-aa8681cabeba service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:09.794581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200985-1414-4c1b-963f-aa8681cabeba service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:09.794853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200985-1414-4c1b-963f-aa8681cabeba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:09.803930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2200985-1414-4c1b-963f-aa8681cabeba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:09.805374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2200985-1414-4c1b-963f-aa8681cabeba service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:09.814742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1130/2253] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:01:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:01:11.138126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455444e6-b209-43e1-9ccd-d7dcb84ee15b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:11.139654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-455444e6-b209-43e1-9ccd-d7dcb84ee15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:11.204863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455444e6-b209-43e1-9ccd-d7dcb84ee15b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:11.210289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:11.211243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:11.211571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:11.211846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] PATH_INFO: `/v3/users/ed0fbd1d4c114fbaa6ec771b8e2687bd` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:11.213115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0fbd1d4c114fbaa6ec771b8e2687bd)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:11.215064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:11.264350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0fbd1d4c114fbaa6ec771b8e2687bd'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.272324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0fbd1d4c114fbaa6ec771b8e2687bd'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.273182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0fbd1d4c114fbaa6ec771b8e2687bd'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.281179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0fbd1d4c114fbaa6ec771b8e2687bd'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.281882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0fbd1d4c114fbaa6ec771b8e2687bd'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.301858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1124/2254] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:01:11 2022] DELETE /identity/v3/users/ed0fbd1d4c114fbaa6ec771b8e2687bd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:11.308928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e012041-8ca9-45f6-b49c-260dbda73706 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:11.308928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e012041-8ca9-45f6-b49c-260dbda73706 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:11.308928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e012041-8ca9-45f6-b49c-260dbda73706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:11.325613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-2e012041-8ca9-45f6-b49c-260dbda73706 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:11.326828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2e012041-8ca9-45f6-b49c-260dbda73706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:11.384834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1131/2255] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:01:11.395128 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:11.396531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:11.460770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c84d5-4179-44ca-87bd-542868659e9b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:11.464485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb357c-c242-44a8-90e2-77c2c8d015c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:11.465132 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb357c-c242-44a8-90e2-77c2c8d015c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:11.465412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb357c-c242-44a8-90e2-77c2c8d015c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:11.465687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb357c-c242-44a8-90e2-77c2c8d015c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:11.475453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb357c-c242-44a8-90e2-77c2c8d015c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:11.476888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb357c-c242-44a8-90e2-77c2c8d015c3 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:11.486608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1125/2256] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:01:11.865858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e012041-8ca9-45f6-b49c-260dbda73706 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:11.867491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2e012041-8ca9-45f6-b49c-260dbda73706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:11.885752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e012041-8ca9-45f6-b49c-260dbda73706 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:11.892115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:11.893097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:11.893540 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:11.894785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] PATH_INFO: `/v3/projects/f58837e3d1b34bb0a37896985a7129f8` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:11.896507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58837e3d1b34bb0a37896985a7129f8)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:11.898401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:11.946145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58837e3d1b34bb0a37896985a7129f8', 'request_id': 'req-674eb0d7-3449-4261-a86a-932ef6fb8093'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.952931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58837e3d1b34bb0a37896985a7129f8', 'request_id': 'req-674eb0d7-3449-4261-a86a-932ef6fb8093'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.958259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58837e3d1b34bb0a37896985a7129f8', 'request_id': 'req-674eb0d7-3449-4261-a86a-932ef6fb8093'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.969816 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] The token cache is being invalidate because project f58837e3d1b34bb0a37896985a7129f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:01:11.970108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.970740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-674eb0d7-3449-4261-a86a-932ef6fb8093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:11.972342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1132/2257] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:01:11 2022] DELETE /identity/v3/projects/f58837e3d1b34bb0a37896985a7129f8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:11.977266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec10f-0485-4cc5-b234-aa8c439a446c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:11.977550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec10f-0485-4cc5-b234-aa8c439a446c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:11.977825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec10f-0485-4cc5-b234-aa8c439a446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:11.995139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-98cec10f-0485-4cc5-b234-aa8c439a446c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:11.996358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-98cec10f-0485-4cc5-b234-aa8c439a446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:12.053409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1126/2258] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:12.062059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb761e8-23bf-4f51-be8d-445d69dfc047 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.062349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb761e8-23bf-4f51-be8d-445d69dfc047 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.062647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb761e8-23bf-4f51-be8d-445d69dfc047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.080699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5bb761e8-23bf-4f51-be8d-445d69dfc047 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:12.081893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5bb761e8-23bf-4f51-be8d-445d69dfc047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:12.089674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1133/2259] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:12.093823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cec10f-0485-4cc5-b234-aa8c439a446c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:12.103931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cec10f-0485-4cc5-b234-aa8c439a446c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:12.113492 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:12.114162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.114444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.114717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.115487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:01:12.115796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:12.118568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:12.130771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1127/2260] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:01:12.135038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb761e8-23bf-4f51-be8d-445d69dfc047 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:12.144260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb761e8-23bf-4f51-be8d-445d69dfc047 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:12.148839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e47926-92d3-49e5-bf97-c760d96ad4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:12.149483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47926-92d3-49e5-bf97-c760d96ad4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.149763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47926-92d3-49e5-bf97-c760d96ad4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.150037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47926-92d3-49e5-bf97-c760d96ad4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.150715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e47926-92d3-49e5-bf97-c760d96ad4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:12.152654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e47926-92d3-49e5-bf97-c760d96ad4c5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:12.178208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1134/2261] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:01:12 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:01:12.182256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:12.192370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b91a80-5164-4a23-a58a-b9b217248207 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:12.248238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb6dea-c104-4dd8-a704-21edbf62a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:12.248902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb6dea-c104-4dd8-a704-21edbf62a551 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.249182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb6dea-c104-4dd8-a704-21edbf62a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.249453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb6dea-c104-4dd8-a704-21edbf62a551 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.250161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb6dea-c104-4dd8-a704-21edbf62a551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:12.252083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb6dea-c104-4dd8-a704-21edbf62a551 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:12.270674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1128/2262] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:01:12 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:01:12.274682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e47926-92d3-49e5-bf97-c760d96ad4c5 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:12.285060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e47926-92d3-49e5-bf97-c760d96ad4c5 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:12.289575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5630515-9577-4ca9-afd4-6716d37f2678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:12.290218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5630515-9577-4ca9-afd4-6716d37f2678 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.290519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5630515-9577-4ca9-afd4-6716d37f2678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.291205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5630515-9577-4ca9-afd4-6716d37f2678 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.291959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5630515-9577-4ca9-afd4-6716d37f2678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:12.293542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5630515-9577-4ca9-afd4-6716d37f2678 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:12.304510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1135/2263] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:01:12.308478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb6dea-c104-4dd8-a704-21edbf62a551 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:12.318547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb6dea-c104-4dd8-a704-21edbf62a551 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:12.323570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd7586-30c2-41aa-a4c2-023a6b03d691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:12.324239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd7586-30c2-41aa-a4c2-023a6b03d691 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.324504 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd7586-30c2-41aa-a4c2-023a6b03d691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.324781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd7586-30c2-41aa-a4c2-023a6b03d691 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.325581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd7586-30c2-41aa-a4c2-023a6b03d691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:12.327169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd7586-30c2-41aa-a4c2-023a6b03d691 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:12.337349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1129/2264] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:01:12.347040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5630515-9577-4ca9-afd4-6716d37f2678 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:12.357036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5630515-9577-4ca9-afd4-6716d37f2678 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:12.362585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:12.363525 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.363806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.364080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] PATH_INFO: `/v3/projects/a0f0edd18447406fa7a5665ff3107c3b/users/2ab2f30b3b4840b988102fd53a9142ef/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.379039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f0edd18447406fa7a5665ff3107c3b, user_id=2ab2f30b3b4840b988102fd53a9142ef, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:12.381654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:12.394812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1136/2265] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:01:12 2022] PUT /identity/v3/projects/a0f0edd18447406fa7a5665ff3107c3b/users/2ab2f30b3b4840b988102fd53a9142ef/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:12.405099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d83dd-1d52-4f15-bcef-868bf2a56280 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.405487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d83dd-1d52-4f15-bcef-868bf2a56280 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.405784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d83dd-1d52-4f15-bcef-868bf2a56280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.431864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-189d83dd-1d52-4f15-bcef-868bf2a56280 None None] MFA Rules not processed for user `2ab2f30b3b4840b988102fd53a9142ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:12.433052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-189d83dd-1d52-4f15-bcef-868bf2a56280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:12.495054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1130/2266] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:01:12.506221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:12.507955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:12.563873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb33e6a-88a3-4417-a830-96a376f8d88f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:12.567492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626063e9-e565-45a4-898b-cfdd895e3cf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:12.568135 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626063e9-e565-45a4-898b-cfdd895e3cf4 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:12.568414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626063e9-e565-45a4-898b-cfdd895e3cf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:12.568691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626063e9-e565-45a4-898b-cfdd895e3cf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:12.577087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626063e9-e565-45a4-898b-cfdd895e3cf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:12.579037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626063e9-e565-45a4-898b-cfdd895e3cf4 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:12.587619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1137/2267] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:01:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:01:27.800239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d83dd-1d52-4f15-bcef-868bf2a56280 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:27.868476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d83dd-1d52-4f15-bcef-868bf2a56280 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:27.872973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:27.873835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:27.874114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:27.874386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] PATH_INFO: `/v3/users/2ab2f30b3b4840b988102fd53a9142ef` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:27.875593 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab2f30b3b4840b988102fd53a9142ef)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:27.877507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:27.922709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab2f30b3b4840b988102fd53a9142ef'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:27.929381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab2f30b3b4840b988102fd53a9142ef'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:27.930042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab2f30b3b4840b988102fd53a9142ef'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:27.937172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab2f30b3b4840b988102fd53a9142ef'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:27.937800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab2f30b3b4840b988102fd53a9142ef'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:27.954926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1131/2268] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:01:27 2022] DELETE /identity/v3/users/2ab2f30b3b4840b988102fd53a9142ef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:27.959483 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b03b-21ac-480b-a2b6-fc9b87949ed8 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:27.959980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b03b-21ac-480b-a2b6-fc9b87949ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:27.960174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b03b-21ac-480b-a2b6-fc9b87949ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:27.977859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-6e86b03b-21ac-480b-a2b6-fc9b87949ed8 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:27.979055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6e86b03b-21ac-480b-a2b6-fc9b87949ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:28.034863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1138/2269] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:28.044244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:28.045676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:28.103237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f0af3-92b7-4904-8b09-81547c0b3fe9 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:28.106943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:28.107627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:28.107913 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:28.108193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:28.117853 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:28.119633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:28.128907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1132/2270] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:01:28.442108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b03b-21ac-480b-a2b6-fc9b87949ed8 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:28.443740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6e86b03b-21ac-480b-a2b6-fc9b87949ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:28.457374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b03b-21ac-480b-a2b6-fc9b87949ed8 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:28.464402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:28.465275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:28.465556 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:28.465829 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] PATH_INFO: `/v3/projects/a0f0edd18447406fa7a5665ff3107c3b` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:28.467018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f0edd18447406fa7a5665ff3107c3b)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:28.469563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:28.517002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f0edd18447406fa7a5665ff3107c3b', 'request_id': 'req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:28.525598 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f0edd18447406fa7a5665ff3107c3b', 'request_id': 'req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:28.532169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f0edd18447406fa7a5665ff3107c3b', 'request_id': 'req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:28.543167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] The token cache is being invalidate because project a0f0edd18447406fa7a5665ff3107c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:01:28.543640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:28.544151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:28.545696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1139/2271] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:01:28 2022] DELETE /identity/v3/projects/a0f0edd18447406fa7a5665ff3107c3b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:33.066838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:33.068309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:33.080061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ac807-1e4a-4d90-879f-159aacda0ff9 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:33.126686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb576e5-bf6d-426b-a990-9c01b3be906d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:33.127361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb576e5-bf6d-426b-a990-9c01b3be906d service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:33.127648 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb576e5-bf6d-426b-a990-9c01b3be906d service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:33.127923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb576e5-bf6d-426b-a990-9c01b3be906d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:33.129708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-feb576e5-bf6d-426b-a990-9c01b3be906d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:33.194245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb576e5-bf6d-426b-a990-9c01b3be906d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:33.195724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb576e5-bf6d-426b-a990-9c01b3be906d service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:33.206020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1133/2272] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:01:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:01:36.198529 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:36.199991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:36.284936 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1196-94b1-4622-8d8c-1bc5c20c7602 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:36.289679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:36.290559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:36.291006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:36.291277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] PATH_INFO: `/v3/users/20e6e60e8b8240b28c66913907beead4` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:36.292495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e6e60e8b8240b28c66913907beead4)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:36.294976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:36.363763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e6e60e8b8240b28c66913907beead4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:36.371862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e6e60e8b8240b28c66913907beead4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:36.379374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e6e60e8b8240b28c66913907beead4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:36.380028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e6e60e8b8240b28c66913907beead4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:36.392374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e6e60e8b8240b28c66913907beead4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:36.398274 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1140/2273] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:01:36 2022] DELETE /identity/v3/users/20e6e60e8b8240b28c66913907beead4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:36.402774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573506-ed77-41b4-bfbb-e95eb380aa1b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:36.403256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573506-ed77-41b4-bfbb-e95eb380aa1b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:36.403407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573506-ed77-41b4-bfbb-e95eb380aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:36.420828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-50573506-ed77-41b4-bfbb-e95eb380aa1b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:36.422059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-50573506-ed77-41b4-bfbb-e95eb380aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:36.489583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1134/2274] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:36.504034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:36.505781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:36.584576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868930d-bf9d-489b-9c04-4405c6d5e416 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:36.589001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2edb5-d7d4-43bc-b7a3-81aba1c46d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:36.589225 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2edb5-d7d4-43bc-b7a3-81aba1c46d58 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:36.589481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2edb5-d7d4-43bc-b7a3-81aba1c46d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:36.589753 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2edb5-d7d4-43bc-b7a3-81aba1c46d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:36.600970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2edb5-d7d4-43bc-b7a3-81aba1c46d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:36.602433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2edb5-d7d4-43bc-b7a3-81aba1c46d58 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:36.613620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1141/2275] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:01:37.008700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50573506-ed77-41b4-bfbb-e95eb380aa1b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:37.010165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-50573506-ed77-41b4-bfbb-e95eb380aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:37.024778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50573506-ed77-41b4-bfbb-e95eb380aa1b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:37.030526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:37.031759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:37.035090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:37.036131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] PATH_INFO: `/v3/projects/815644b884384ef79997746af0c5e7bb` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:37.037580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=815644b884384ef79997746af0c5e7bb)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:37.040980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:37.159109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815644b884384ef79997746af0c5e7bb', 'request_id': 'req-528be9c7-16ac-4739-bd65-65a34498e5f8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:37.167738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815644b884384ef79997746af0c5e7bb', 'request_id': 'req-528be9c7-16ac-4739-bd65-65a34498e5f8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:37.179848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815644b884384ef79997746af0c5e7bb', 'request_id': 'req-528be9c7-16ac-4739-bd65-65a34498e5f8'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:37.194660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] The token cache is being invalidate because project 815644b884384ef79997746af0c5e7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:01:37.195083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:37.195918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:01:37.198090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1135/2276] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:01:37 2022] DELETE /identity/v3/projects/815644b884384ef79997746af0c5e7bb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:01:37.628048 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297b2a9-4e9e-4b4c-86df-ce0690cbbcc4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:37.628863 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297b2a9-4e9e-4b4c-86df-ce0690cbbcc4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:37.629313 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297b2a9-4e9e-4b4c-86df-ce0690cbbcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:37.658731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8297b2a9-4e9e-4b4c-86df-ce0690cbbcc4 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:01:37.660310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8297b2a9-4e9e-4b4c-86df-ce0690cbbcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:37.723001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1142/2277] 10.222.0.93 () {58 vars in 967 bytes} [Wed May 11 19:01:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:01:37.755403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:01:37.758184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:01:37.845267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528be9c7-16ac-4739-bd65-65a34498e5f8 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:01:37.852259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78363-8d78-40be-886b-e61de4d30295 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:01:37.852986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78363-8d78-40be-886b-e61de4d30295 service swift] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:01:37.853341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78363-8d78-40be-886b-e61de4d30295 service swift] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:01:37.853949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78363-8d78-40be-886b-e61de4d30295 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:01:37.863412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a78363-8d78-40be-886b-e61de4d30295 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:01:37.865494 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a78363-8d78-40be-886b-e61de4d30295 service swift] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:01:37.875142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1136/2278] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:01:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 19:02:16.110002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa073-c403-45fd-9c83-e44871dc6d4a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:02:16.110547 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa073-c403-45fd-9c83-e44871dc6d4a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:02:16.110547 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaa073-c403-45fd-9c83-e44871dc6d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:02:16.128737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-00eaa073-c403-45fd-9c83-e44871dc6d4a None None] MFA Rules not processed for user `f1f10686b4814794aadc34ec6194cc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:02:16.129938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-00eaa073-c403-45fd-9c83-e44871dc6d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:16.182149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1143/2279] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:02:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:02:28.536017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d44925-2a01-44e4-9aa8-a01a2fdc8968 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:02:28.536579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d44925-2a01-44e4-9aa8-a01a2fdc8968 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:02:28.536819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d44925-2a01-44e4-9aa8-a01a2fdc8968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:02:28.554931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-14d44925-2a01-44e4-9aa8-a01a2fdc8968 None None] MFA Rules not processed for user `c9d83909ea2943f5834778a2a9aa1485`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:02:28.556151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-14d44925-2a01-44e4-9aa8-a01a2fdc8968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:28.611147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1137/2280] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:02:33.190093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaa073-c403-45fd-9c83-e44871dc6d4a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:02:33.191562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-00eaa073-c403-45fd-9c83-e44871dc6d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:33.251409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaa073-c403-45fd-9c83-e44871dc6d4a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:02:33.254960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed82e3-c39f-4a30-a8b5-33340bef4c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:02:33.255636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed82e3-c39f-4a30-a8b5-33340bef4c7c service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:02:33.255921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed82e3-c39f-4a30-a8b5-33340bef4c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:02:33.256198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed82e3-c39f-4a30-a8b5-33340bef4c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:02:33.257983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6bed82e3-c39f-4a30-a8b5-33340bef4c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:33.330582 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed82e3-c39f-4a30-a8b5-33340bef4c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:02:33.332014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed82e3-c39f-4a30-a8b5-33340bef4c7c service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:02:33.344338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1144/2281] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:02:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:02:33.780931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d44925-2a01-44e4-9aa8-a01a2fdc8968 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:02:33.782404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-14d44925-2a01-44e4-9aa8-a01a2fdc8968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:33.795268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d44925-2a01-44e4-9aa8-a01a2fdc8968 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:02:33.799760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:02:33.800410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:02:33.800688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:02:33.800991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:02:33.802906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:33.817441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:02:33.820061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:02:33.832139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1138/2282] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:02:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:02:44.979795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b478d-8b4b-49f9-a5fd-4cb8e7224e68 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:02:44.980315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b478d-8b4b-49f9-a5fd-4cb8e7224e68 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:02:44.980567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b478d-8b4b-49f9-a5fd-4cb8e7224e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:02:44.998267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-698b478d-8b4b-49f9-a5fd-4cb8e7224e68 None None] MFA Rules not processed for user `378aab35909343d88c0250493e41be34`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:02:45.000124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-698b478d-8b4b-49f9-a5fd-4cb8e7224e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:45.052001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1145/2283] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:02:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:02:45.064020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:02:45.065419 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:45.078947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3370d0-90f1-4d3f-ac9c-726d5bf83c83 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:02:45.084302 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:02:45.084924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:02:45.085203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:02:45.085474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:02:45.087178 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:45.097111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:02:45.098688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:02:45.107365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1139/2284] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:02:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:02:45.700618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b478d-8b4b-49f9-a5fd-4cb8e7224e68 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:02:45.702050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-698b478d-8b4b-49f9-a5fd-4cb8e7224e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:45.772558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b478d-8b4b-49f9-a5fd-4cb8e7224e68 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:02:45.777539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '911d21a666844fc399286e24c2892184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:02:45.778183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:02:45.778831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:02:45.779100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:02:45.781549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:45.792653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:02:45.794243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:02:45.803874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1146/2285] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:02:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:02:48.516108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:02:48.538237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf601a0-a61e-4d6f-b5d9-d9885906148d service nova] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:02:48.541858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7e05f-2d16-4a1b-9e70-b780e16eccad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:02:48.542512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e05f-2d16-4a1b-9e70-b780e16eccad service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:02:48.542784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e05f-2d16-4a1b-9e70-b780e16eccad service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:02:48.543056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e05f-2d16-4a1b-9e70-b780e16eccad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:02:48.544895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-48e7e05f-2d16-4a1b-9e70-b780e16eccad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:02:48.556029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7e05f-2d16-4a1b-9e70-b780e16eccad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:02:48.557467 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7e05f-2d16-4a1b-9e70-b780e16eccad service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:02:48.567230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1140/2286] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:02:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:09.188831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:09.204396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f640-4e01-4003-a4c1-64035acc7c71 service placement] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:09.216765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:09.217670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:09.219230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:09.227018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:09.230793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:09.247924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:09.251010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:09.263731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1147/2287] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:19.234497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3b76-dfd4-434b-8118-30aa3713ff8d None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:19.234985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3b76-dfd4-434b-8118-30aa3713ff8d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:19.235078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3b76-dfd4-434b-8118-30aa3713ff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:19.252940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-66ef3b76-dfd4-434b-8118-30aa3713ff8d None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:19.254121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-66ef3b76-dfd4-434b-8118-30aa3713ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:19.261075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1141/2288] 10.222.0.93 () {58 vars in 967 bytes} [Wed May 11 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:19.307015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:19.318609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a481c-4508-4002-8adc-7b7b7135e888 service nova] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:19.324040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:19.324679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:19.324961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:19.325236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:19.333795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:19.335419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:19.343578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1148/2289] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:03:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 19:03:22.116001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef3b76-dfd4-434b-8118-30aa3713ff8d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:22.117460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-66ef3b76-dfd4-434b-8118-30aa3713ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:22.173908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef3b76-dfd4-434b-8118-30aa3713ff8d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:22.178031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:22.178737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:22.179021 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:22.179318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:22.181220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:22.192478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:22.194099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:22.203549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1142/2290] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:26.483426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:26.485484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:26.550022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780451f3-5bbd-4dd4-854b-149a8aa69a6d service swift] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:26.554474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:26.555353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:26.555635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:26.555903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] PATH_INFO: `/v3/users/2558a8c34b324bc99b157b306c9cdf7b` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:26.557065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2558a8c34b324bc99b157b306c9cdf7b)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:26.558970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:26.607843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2558a8c34b324bc99b157b306c9cdf7b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.615050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2558a8c34b324bc99b157b306c9cdf7b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.622141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2558a8c34b324bc99b157b306c9cdf7b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.622759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2558a8c34b324bc99b157b306c9cdf7b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.634658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2558a8c34b324bc99b157b306c9cdf7b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.641160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1149/2291] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:03:26 2022] DELETE /identity/v3/users/2558a8c34b324bc99b157b306c9cdf7b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:26.813401 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:26.827384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e9a99-69d0-489d-887b-61f31a49d512 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:26.881977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:26.882851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:26.883139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:26.883452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] PATH_INFO: `/v3/projects/4be93dc182224cfe8be43a23dadbb62f` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:26.884642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be93dc182224cfe8be43a23dadbb62f)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:26.886562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:26.930703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be93dc182224cfe8be43a23dadbb62f', 'request_id': 'req-b795530a-7a19-41b4-b206-1bb345eb38f7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.935934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be93dc182224cfe8be43a23dadbb62f', 'request_id': 'req-b795530a-7a19-41b4-b206-1bb345eb38f7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.944036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be93dc182224cfe8be43a23dadbb62f', 'request_id': 'req-b795530a-7a19-41b4-b206-1bb345eb38f7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.954838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] The token cache is being invalidate because project 4be93dc182224cfe8be43a23dadbb62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:03:26.955121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.955766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:26.957319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1143/2292] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:03:26 2022] DELETE /identity/v3/projects/4be93dc182224cfe8be43a23dadbb62f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:26.961324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:26.962759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:26.975710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93770a-5d5c-4a13-acc8-b4f196ee17e9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:27.031461 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:27.032263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:27.032541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:27.032819 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] PATH_INFO: `/v3/users/9af299ecc293408b9389b0a72d38bbae` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:27.033987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af299ecc293408b9389b0a72d38bbae)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:27.035948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:27.081567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af299ecc293408b9389b0a72d38bbae'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.088548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af299ecc293408b9389b0a72d38bbae'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.095554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af299ecc293408b9389b0a72d38bbae'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.096172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af299ecc293408b9389b0a72d38bbae'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.107647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af299ecc293408b9389b0a72d38bbae'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.113972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1150/2293] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:03:26 2022] DELETE /identity/v3/users/9af299ecc293408b9389b0a72d38bbae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:27.245326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:27.246755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:27.289897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:27.291587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:27.326795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795530a-7a19-41b4-b206-1bb345eb38f7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:27.372853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f06e96-0e5f-4009-9a8b-11d5225f3930 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:27.377558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:27.378415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:27.378692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:27.378966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] PATH_INFO: `/v3/projects/566f9e92e0ad427196ce6ed231b95f60` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:27.380171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566f9e92e0ad427196ce6ed231b95f60)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:27.382060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:27.391856 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:27.392510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:27.392786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:27.393058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:27.394820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:27.435249 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566f9e92e0ad427196ce6ed231b95f60', 'request_id': 'req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.444251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566f9e92e0ad427196ce6ed231b95f60', 'request_id': 'req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.451014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566f9e92e0ad427196ce6ed231b95f60', 'request_id': 'req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.456033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:27.457616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:27.465226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] The token cache is being invalidate because project 566f9e92e0ad427196ce6ed231b95f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:03:27.465518 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.466179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:27.466863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1144/2294] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:27.469497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1151/2295] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:03:27 2022] DELETE /identity/v3/projects/566f9e92e0ad427196ce6ed231b95f60 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:03:43.168573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:43.169972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:43.225429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb00c-ee79-4c47-a43a-8c044443588b service nova] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:43.275924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:43.276831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:43.277121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:43.277398 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:43.279282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:43.342071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:43.343666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:43.352627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1145/2296] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:44.376427 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:44.377813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:44.434022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8b00-191b-4855-a3e0-f194b7c2f6e6 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:44.437537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:44.438166 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:44.438440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:44.438708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:44.440442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:44.500555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:44.501926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:44.511432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1152/2297] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:46.207781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:46.210780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:46.334813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6df7-95d6-4f5b-bc35-ceb637a7c16f service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:46.341003 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dec49a-f2fb-43aa-9dff-461fa9208fe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:46.341675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec49a-f2fb-43aa-9dff-461fa9208fe4 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:46.341956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec49a-f2fb-43aa-9dff-461fa9208fe4 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:46.342238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec49a-f2fb-43aa-9dff-461fa9208fe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:46.345028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-06dec49a-f2fb-43aa-9dff-461fa9208fe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:46.390588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dec49a-f2fb-43aa-9dff-461fa9208fe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:46.393116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dec49a-f2fb-43aa-9dff-461fa9208fe4 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:46.411088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1146/2298] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:49.219465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:49.221212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:49.240180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e5b4-f824-42af-a824-bcb79326d1bc service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:49.243988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f515e8-5449-4fc5-865b-c50d38300ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:49.244813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f515e8-5449-4fc5-865b-c50d38300ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:49.245094 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f515e8-5449-4fc5-865b-c50d38300ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:49.245364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f515e8-5449-4fc5-865b-c50d38300ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:49.247592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-78f515e8-5449-4fc5-865b-c50d38300ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:49.262169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f515e8-5449-4fc5-865b-c50d38300ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:49.264738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f515e8-5449-4fc5-865b-c50d38300ff2 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:49.275037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1153/2299] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:49.444765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99162-b31e-4602-887b-9741df3885bf None None] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:49.445315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99162-b31e-4602-887b-9741df3885bf None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:49.445315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99162-b31e-4602-887b-9741df3885bf None None] PATH_INFO: `/` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:49.446902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1147/2300] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 19:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 19:03:49.454355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597303-6734-403d-b99e-153f7d4535a2 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:49.454835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597303-6734-403d-b99e-153f7d4535a2 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:49.455322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597303-6734-403d-b99e-153f7d4535a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:49.481544 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b1597303-6734-403d-b99e-153f7d4535a2 None None] MFA Rules not processed for user `af0204b62913420a90303c42dbded7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:49.482958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b1597303-6734-403d-b99e-153f7d4535a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:49.498178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1154/2301] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 19:03:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:49.526908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99162-b31e-4602-887b-9741df3885bf None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:49.549603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99162-b31e-4602-887b-9741df3885bf None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:49.560435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87a1d1-10ed-4cc8-919f-5e4f5ab290b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:49.561268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a1d1-10ed-4cc8-919f-5e4f5ab290b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:49.562339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a1d1-10ed-4cc8-919f-5e4f5ab290b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:49.562635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a1d1-10ed-4cc8-919f-5e4f5ab290b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:49.584329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87a1d1-10ed-4cc8-919f-5e4f5ab290b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:49.585804 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87a1d1-10ed-4cc8-919f-5e4f5ab290b9 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:49.596082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1148/2302] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:50.026908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972ea4-78ce-4547-b0af-0e223bf410ed None None] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:50.027927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972ea4-78ce-4547-b0af-0e223bf410ed None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:50.028397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972ea4-78ce-4547-b0af-0e223bf410ed None None] PATH_INFO: `/` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:50.030981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1155/2303] 10.222.0.93 () {54 vars in 921 bytes} [Wed May 11 19:03:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 19:03:50.037790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcd79a-9bcf-4503-80f7-75de78baf50a None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:50.038375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcd79a-9bcf-4503-80f7-75de78baf50a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:50.038936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcd79a-9bcf-4503-80f7-75de78baf50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:50.065472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-dbdcd79a-9bcf-4503-80f7-75de78baf50a None None] MFA Rules not processed for user `aaff3fdfbc054b8f86a2f9aaa98a70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:50.066752 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-dbdcd79a-9bcf-4503-80f7-75de78baf50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:50.078817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1149/2304] 10.222.0.93 () {58 vars in 1018 bytes} [Wed May 11 19:03:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:50.094772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972ea4-78ce-4547-b0af-0e223bf410ed None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:50.111280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972ea4-78ce-4547-b0af-0e223bf410ed None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:50.114984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2e15-30ad-4a93-b73d-8e6dbf9cc98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:50.115954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2e15-30ad-4a93-b73d-8e6dbf9cc98b service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:50.117148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2e15-30ad-4a93-b73d-8e6dbf9cc98b service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:50.117431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2e15-30ad-4a93-b73d-8e6dbf9cc98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:50.133704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2e15-30ad-4a93-b73d-8e6dbf9cc98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:50.135287 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2e15-30ad-4a93-b73d-8e6dbf9cc98b service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:50.148376 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1156/2305] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:50.226477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcd79a-9bcf-4503-80f7-75de78baf50a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:50.228338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-dbdcd79a-9bcf-4503-80f7-75de78baf50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:50.246229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcd79a-9bcf-4503-80f7-75de78baf50a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:50.253544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:50.254602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:50.255035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:50.255493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] PATH_INFO: `/v3/users/c9d83909ea2943f5834778a2a9aa1485` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:50.257632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d83909ea2943f5834778a2a9aa1485)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:50.260633 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:50.344119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d83909ea2943f5834778a2a9aa1485'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:50.357679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d83909ea2943f5834778a2a9aa1485'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:50.366331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d83909ea2943f5834778a2a9aa1485'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:50.376705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d83909ea2943f5834778a2a9aa1485'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:50.377216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-82260475-a745-4410-9dee-43681bd21db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d83909ea2943f5834778a2a9aa1485'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:50.402982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1150/2306] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:03:50 2022] DELETE /identity/v3/users/c9d83909ea2943f5834778a2a9aa1485 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:50.828493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2e15-30ad-4a93-b73d-8e6dbf9cc98b service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:50.850371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2e15-30ad-4a93-b73d-8e6dbf9cc98b service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:50.951224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:50.952182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:50.952467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:50.952741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] PATH_INFO: `/v3/projects/1d22bd9d4df840c1af348b3f257593a3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:50.953964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d22bd9d4df840c1af348b3f257593a3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:50.956539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.017822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d22bd9d4df840c1af348b3f257593a3', 'request_id': 'req-03bc349c-419d-4763-b8dd-0c8c53a05e6a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:51.031132 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d22bd9d4df840c1af348b3f257593a3', 'request_id': 'req-03bc349c-419d-4763-b8dd-0c8c53a05e6a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:51.039942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d22bd9d4df840c1af348b3f257593a3', 'request_id': 'req-03bc349c-419d-4763-b8dd-0c8c53a05e6a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:51.054498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] The token cache is being invalidate because project 1d22bd9d4df840c1af348b3f257593a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:03:51.054781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:51.055504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:51.058074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1157/2307] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:03:50 2022] DELETE /identity/v3/projects/1d22bd9d4df840c1af348b3f257593a3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:51.063663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd787f4-a440-48cb-b19a-955fde61c177 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.064597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd787f4-a440-48cb-b19a-955fde61c177 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.065120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd787f4-a440-48cb-b19a-955fde61c177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.088226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-5dd787f4-a440-48cb-b19a-955fde61c177 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:51.090292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5dd787f4-a440-48cb-b19a-955fde61c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:51.107964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.109671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:51.172944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1151/2308] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:51.174896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9640a4-e4c6-4483-a807-cadb00e00a58 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.175440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9640a4-e4c6-4483-a807-cadb00e00a58 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.175887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9640a4-e4c6-4483-a807-cadb00e00a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.208036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4a9640a4-e4c6-4483-a807-cadb00e00a58 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:51.209744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4a9640a4-e4c6-4483-a807-cadb00e00a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:51.220769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1152/2309] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:51.225761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9640a4-e4c6-4483-a807-cadb00e00a58 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.239844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9640a4-e4c6-4483-a807-cadb00e00a58 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:51.247719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:51.249120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.249586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.250000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.250148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc349c-419d-4763-b8dd-0c8c53a05e6a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:51.251031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:03:51.251408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:51.253721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.258745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:51.259876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.260375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.260681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.264165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:51.274521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1153/2310] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:03:51.275928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.289604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839d9b4-7382-447b-95b2-8d4a38302e8a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:51.289848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:51.292881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.297436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7582-080d-47e9-8755-36de2d5c6555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:51.298385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7582-080d-47e9-8755-36de2d5c6555 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.298883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7582-080d-47e9-8755-36de2d5c6555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.299270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7582-080d-47e9-8755-36de2d5c6555 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.302561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7582-080d-47e9-8755-36de2d5c6555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:51.303605 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7582-080d-47e9-8755-36de2d5c6555 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.309050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1158/2311] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:03:51.361095 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1154/2312] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:03:51 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:51.365320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.383672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b53e8-6487-4fe7-8971-4cfb32d46a43 service nova] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:51.496199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308b721-5f9e-41cb-bf0f-8bf7ec071c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:51.497764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b721-5f9e-41cb-bf0f-8bf7ec071c70 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.498347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b721-5f9e-41cb-bf0f-8bf7ec071c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.498801 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b721-5f9e-41cb-bf0f-8bf7ec071c70 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.500224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308b721-5f9e-41cb-bf0f-8bf7ec071c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:51.504194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308b721-5f9e-41cb-bf0f-8bf7ec071c70 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.529820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1159/2313] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:03:51 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:51.534523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7582-080d-47e9-8755-36de2d5c6555 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.546172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7582-080d-47e9-8755-36de2d5c6555 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:51.550946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c4c11-16fc-4874-a74e-188d41bc4b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:51.552163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c4c11-16fc-4874-a74e-188d41bc4b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.553145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c4c11-16fc-4874-a74e-188d41bc4b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.553145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c4c11-16fc-4874-a74e-188d41bc4b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.553583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c4c11-16fc-4874-a74e-188d41bc4b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:51.555186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c4c11-16fc-4874-a74e-188d41bc4b7f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.569249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1155/2314] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:03:51.573056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308b721-5f9e-41cb-bf0f-8bf7ec071c70 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.584716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308b721-5f9e-41cb-bf0f-8bf7ec071c70 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:51.590167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26414e4e-1345-4bc5-9e14-5bb0a6f71c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:51.591338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414e4e-1345-4bc5-9e14-5bb0a6f71c7e admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.591338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414e4e-1345-4bc5-9e14-5bb0a6f71c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.591733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414e4e-1345-4bc5-9e14-5bb0a6f71c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.592622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26414e4e-1345-4bc5-9e14-5bb0a6f71c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:51.594317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26414e4e-1345-4bc5-9e14-5bb0a6f71c7e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.608254 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1160/2315] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:03:51.609408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c4c11-16fc-4874-a74e-188d41bc4b7f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.620188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c4c11-16fc-4874-a74e-188d41bc4b7f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:51.625787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ca871-ca81-4a1f-9d58-678089fe9ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:51.626775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca871-ca81-4a1f-9d58-678089fe9ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.627120 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca871-ca81-4a1f-9d58-678089fe9ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.627493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca871-ca81-4a1f-9d58-678089fe9ac2 admin admin] PATH_INFO: `/v3/projects/2eb782131d0a45ebb268ad87a9718465/users/d19f6cbf61ae43f2aea0ed869e6e46fe/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.652666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ca871-ca81-4a1f-9d58-678089fe9ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb782131d0a45ebb268ad87a9718465, user_id=d19f6cbf61ae43f2aea0ed869e6e46fe, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:51.656210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ca871-ca81-4a1f-9d58-678089fe9ac2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.673900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1156/2316] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:51 2022] PUT /identity/v3/projects/2eb782131d0a45ebb268ad87a9718465/users/d19f6cbf61ae43f2aea0ed869e6e46fe/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:51.684506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600c9ce-5128-4f5e-ace0-5fea1dc44759 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.684803 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600c9ce-5128-4f5e-ace0-5fea1dc44759 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.685080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600c9ce-5128-4f5e-ace0-5fea1dc44759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.723808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-2600c9ce-5128-4f5e-ace0-5fea1dc44759 None None] MFA Rules not processed for user `d19f6cbf61ae43f2aea0ed869e6e46fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:51.725953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2600c9ce-5128-4f5e-ace0-5fea1dc44759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:51.804195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1161/2317] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:51.809170 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ca871-ca81-4a1f-9d58-678089fe9ac2 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.880124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ca871-ca81-4a1f-9d58-678089fe9ac2 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:51.885597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d0b7-57f5-4e56-8a87-0d12900d2395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:51.886262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d0b7-57f5-4e56-8a87-0d12900d2395 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:51.886544 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d0b7-57f5-4e56-8a87-0d12900d2395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:51.886818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d0b7-57f5-4e56-8a87-0d12900d2395 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:51.887556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1d0b7-57f5-4e56-8a87-0d12900d2395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:51.890059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1d0b7-57f5-4e56-8a87-0d12900d2395 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:51.921705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1157/2318] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:03:51 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:51.923973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600c9ce-5128-4f5e-ace0-5fea1dc44759 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:51.940949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600c9ce-5128-4f5e-ace0-5fea1dc44759 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:52.006320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade879-051d-445c-9bf1-9640c26aaf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:52.007216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade879-051d-445c-9bf1-9640c26aaf58 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.007216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade879-051d-445c-9bf1-9640c26aaf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.007546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade879-051d-445c-9bf1-9640c26aaf58 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.008239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ade879-051d-445c-9bf1-9640c26aaf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:52.010213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ade879-051d-445c-9bf1-9640c26aaf58 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:52.032155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1162/2319] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:03:51 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:52.037238 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d0b7-57f5-4e56-8a87-0d12900d2395 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:52.049500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d0b7-57f5-4e56-8a87-0d12900d2395 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:52.056256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450c3bf-d4fd-4ca5-8f34-2f725862f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:52.058206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450c3bf-d4fd-4ca5-8f34-2f725862f409 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.058489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450c3bf-d4fd-4ca5-8f34-2f725862f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.060433 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450c3bf-d4fd-4ca5-8f34-2f725862f409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.062207 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450c3bf-d4fd-4ca5-8f34-2f725862f409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:52.064732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450c3bf-d4fd-4ca5-8f34-2f725862f409 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:52.081151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1158/2320] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:03:52.085124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade879-051d-445c-9bf1-9640c26aaf58 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:52.096725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade879-051d-445c-9bf1-9640c26aaf58 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:52.102315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c3576-5775-4790-9b36-517b86bf795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:52.103509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c3576-5775-4790-9b36-517b86bf795c admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.103790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c3576-5775-4790-9b36-517b86bf795c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.104062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c3576-5775-4790-9b36-517b86bf795c admin admin] PATH_INFO: `/v3/projects/c526941d1193421ebaf7987776be4239/users/9e23fb9161494c4b8edcae4fd6215926/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.120711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c3576-5775-4790-9b36-517b86bf795c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c526941d1193421ebaf7987776be4239, user_id=9e23fb9161494c4b8edcae4fd6215926, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:52.124416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c3576-5775-4790-9b36-517b86bf795c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:52.143122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1163/2321] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:52 2022] PUT /identity/v3/projects/c526941d1193421ebaf7987776be4239/users/9e23fb9161494c4b8edcae4fd6215926/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:52.147995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450c3bf-d4fd-4ca5-8f34-2f725862f409 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:52.158252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450c3bf-d4fd-4ca5-8f34-2f725862f409 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:52.240385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbbb27-e1cb-4ccb-bb93-93a8b2e3f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:52.241164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbbb27-e1cb-4ccb-bb93-93a8b2e3f73a admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.241436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbbb27-e1cb-4ccb-bb93-93a8b2e3f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.242000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbbb27-e1cb-4ccb-bb93-93a8b2e3f73a admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.242778 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbbb27-e1cb-4ccb-bb93-93a8b2e3f73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:52.244449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbbb27-e1cb-4ccb-bb93-93a8b2e3f73a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:52.259077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1159/2322] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:52.260343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c3576-5775-4790-9b36-517b86bf795c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:52.273768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c3576-5775-4790-9b36-517b86bf795c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:52.278937 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:52.279878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.280187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.280459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] PATH_INFO: `/v3/projects/c526941d1193421ebaf7987776be4239/users/9e23fb9161494c4b8edcae4fd6215926/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.283335 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c526941d1193421ebaf7987776be4239, user_id=9e23fb9161494c4b8edcae4fd6215926, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:52.286022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:52.298782 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1164/2323] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:52 2022] PUT /identity/v3/projects/c526941d1193421ebaf7987776be4239/users/9e23fb9161494c4b8edcae4fd6215926/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:52.309637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474295d-767d-4eff-82ec-0c92272b2c78 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.309921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474295d-767d-4eff-82ec-0c92272b2c78 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.310374 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474295d-767d-4eff-82ec-0c92272b2c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.342350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9474295d-767d-4eff-82ec-0c92272b2c78 None None] MFA Rules not processed for user `9e23fb9161494c4b8edcae4fd6215926`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:52.343676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9474295d-767d-4eff-82ec-0c92272b2c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:52.422235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1160/2324] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:52 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:52.429484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:52.431475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:52.522243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18b971-c4a3-49c0-b6e6-88fd966bb60f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:52.525902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cca50-70dc-4e56-9aed-ff4d134599fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:52.526551 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cca50-70dc-4e56-9aed-ff4d134599fc service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.526826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cca50-70dc-4e56-9aed-ff4d134599fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.527096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cca50-70dc-4e56-9aed-ff4d134599fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.536654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cca50-70dc-4e56-9aed-ff4d134599fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:52.538631 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cca50-70dc-4e56-9aed-ff4d134599fc service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:52.549215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1165/2325] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:52.618891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893c228-c5eb-446e-b9e5-ce789874a162 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.619217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893c228-c5eb-446e-b9e5-ce789874a162 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.619563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893c228-c5eb-446e-b9e5-ce789874a162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.645372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-8893c228-c5eb-446e-b9e5-ce789874a162 None None] MFA Rules not processed for user `f8edf1e5f81c4e81b346c82cb48a47f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:52.646588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8893c228-c5eb-446e-b9e5-ce789874a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:52.724329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1161/2326] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:52.731411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ede5-4931-42a8-9c27-30475ca4080f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:52.731794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ede5-4931-42a8-9c27-30475ca4080f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:52.732202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ede5-4931-42a8-9c27-30475ca4080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:52.766225 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d087ede5-4931-42a8-9c27-30475ca4080f None None] MFA Rules not processed for user `f1f10686b4814794aadc34ec6194cc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:52.772395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d087ede5-4931-42a8-9c27-30475ca4080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:52.865060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1166/2327] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:53.012920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893c228-c5eb-446e-b9e5-ce789874a162 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:53.085602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087ede5-4931-42a8-9c27-30475ca4080f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:53.086561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893c228-c5eb-446e-b9e5-ce789874a162 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:53.088214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d087ede5-4931-42a8-9c27-30475ca4080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:53.091923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:53.093056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:53.093334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:53.093737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] PATH_INFO: `/v3/users/d19f6cbf61ae43f2aea0ed869e6e46fe` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:53.094934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19f6cbf61ae43f2aea0ed869e6e46fe)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:53.096876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:53.149618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19f6cbf61ae43f2aea0ed869e6e46fe'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.157417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19f6cbf61ae43f2aea0ed869e6e46fe'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.158242 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19f6cbf61ae43f2aea0ed869e6e46fe'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.167237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19f6cbf61ae43f2aea0ed869e6e46fe'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.168133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4d285252-db04-4542-8e56-c7a3cd41c3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19f6cbf61ae43f2aea0ed869e6e46fe'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.171211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087ede5-4931-42a8-9c27-30475ca4080f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:53.174849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:53.175534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:53.175818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:53.176126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:53.177921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:53.188374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:53.189414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1162/2328] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:03:53 2022] DELETE /identity/v3/users/d19f6cbf61ae43f2aea0ed869e6e46fe => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:53.190098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:53.194047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa79e-f9ef-4614-97cf-e7d9e11d59ef None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:53.194464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa79e-f9ef-4614-97cf-e7d9e11d59ef None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:53.194869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa79e-f9ef-4614-97cf-e7d9e11d59ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:53.202875 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1167/2329] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:53.214147 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b83fa79e-f9ef-4614-97cf-e7d9e11d59ef None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:53.215391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b83fa79e-f9ef-4614-97cf-e7d9e11d59ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:53.286577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1163/2330] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:03:53.304182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:53.305607 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:53.315771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f935f4e-203c-443e-a2d0-85081c65a25a service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:53.368780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be58b-01e3-43fd-b1bd-d790a18bfaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:53.369437 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be58b-01e3-43fd-b1bd-d790a18bfaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:53.369717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be58b-01e3-43fd-b1bd-d790a18bfaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:53.369990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be58b-01e3-43fd-b1bd-d790a18bfaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:53.379751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be58b-01e3-43fd-b1bd-d790a18bfaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:53.381252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be58b-01e3-43fd-b1bd-d790a18bfaa1 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:53.391880 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1168/2331] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:53.771975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fa79e-f9ef-4614-97cf-e7d9e11d59ef None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:53.773714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b83fa79e-f9ef-4614-97cf-e7d9e11d59ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:53.796788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fa79e-f9ef-4614-97cf-e7d9e11d59ef None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:53.820687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:53.821848 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:53.822235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:53.822781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] PATH_INFO: `/v3/projects/2eb782131d0a45ebb268ad87a9718465` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:53.824280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb782131d0a45ebb268ad87a9718465)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:53.826355 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:53.919408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb782131d0a45ebb268ad87a9718465', 'request_id': 'req-348ce734-56ac-4257-b7b4-fac31eb047ad'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.930093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb782131d0a45ebb268ad87a9718465', 'request_id': 'req-348ce734-56ac-4257-b7b4-fac31eb047ad'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.938568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb782131d0a45ebb268ad87a9718465', 'request_id': 'req-348ce734-56ac-4257-b7b4-fac31eb047ad'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.954615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] The token cache is being invalidate because project 2eb782131d0a45ebb268ad87a9718465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:03:53.954869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.957941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:53.957941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1164/2332] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:03:53 2022] DELETE /identity/v3/projects/2eb782131d0a45ebb268ad87a9718465 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:53.962266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be58b-01e3-43fd-b1bd-d790a18bfaa1 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:53.979219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be58b-01e3-43fd-b1bd-d790a18bfaa1 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:54.056593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:54.057474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:54.057747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:54.058013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] PATH_INFO: `/v3/users/9e23fb9161494c4b8edcae4fd6215926` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:54.059221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e23fb9161494c4b8edcae4fd6215926)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:54.063521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:54.118892 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e23fb9161494c4b8edcae4fd6215926'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.127110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e23fb9161494c4b8edcae4fd6215926'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.134293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e23fb9161494c4b8edcae4fd6215926'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.135054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e23fb9161494c4b8edcae4fd6215926'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.150256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-aba78b8c-bbf9-4c6b-9a0d-86306301217d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e23fb9161494c4b8edcae4fd6215926'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.156711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1169/2333] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:03:53 2022] DELETE /identity/v3/users/9e23fb9161494c4b8edcae4fd6215926 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:54.460565 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:54.462112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:54.477039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ce734-56ac-4257-b7b4-fac31eb047ad admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:54.534613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:54.535507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:54.535788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:54.536058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] PATH_INFO: `/v3/projects/c526941d1193421ebaf7987776be4239` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:54.537275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c526941d1193421ebaf7987776be4239)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:54.539170 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:54.586716 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c526941d1193421ebaf7987776be4239', 'request_id': 'req-7ce4acaa-36cd-42d4-8b63-869cf34926bd'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.591917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c526941d1193421ebaf7987776be4239', 'request_id': 'req-7ce4acaa-36cd-42d4-8b63-869cf34926bd'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.600054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c526941d1193421ebaf7987776be4239', 'request_id': 'req-7ce4acaa-36cd-42d4-8b63-869cf34926bd'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.611451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] The token cache is being invalidate because project c526941d1193421ebaf7987776be4239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:03:54.611737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.612389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7ce4acaa-36cd-42d4-8b63-869cf34926bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:54.617165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1165/2334] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:03:54 2022] DELETE /identity/v3/projects/c526941d1193421ebaf7987776be4239 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:54.620262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ab5e-a90c-4c8b-8730-f09ad4192872 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:54.620655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ab5e-a90c-4c8b-8730-f09ad4192872 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:54.621210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ab5e-a90c-4c8b-8730-f09ad4192872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:54.648834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b0b9ab5e-a90c-4c8b-8730-f09ad4192872 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:54.650821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b0b9ab5e-a90c-4c8b-8730-f09ad4192872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:54.725596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1170/2335] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:54.734146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eface8-b618-4e31-820d-2b8e40a56f3a None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:54.734672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eface8-b618-4e31-820d-2b8e40a56f3a None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:54.735138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eface8-b618-4e31-820d-2b8e40a56f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:54.756044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-58eface8-b618-4e31-820d-2b8e40a56f3a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:54.757639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-58eface8-b618-4e31-820d-2b8e40a56f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:54.768687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1166/2336] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:54.771722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9ab5e-a90c-4c8b-8730-f09ad4192872 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:54.783114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9ab5e-a90c-4c8b-8730-f09ad4192872 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:54.788146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:54.789259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:54.789259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:54.789468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:54.790019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:03:54.790322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:54.792174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:54.809578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1171/2337] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:03:54.810707 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eface8-b618-4e31-820d-2b8e40a56f3a None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:54.822439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eface8-b618-4e31-820d-2b8e40a56f3a None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:54.827771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ced9-5890-4141-abd7-f7c1b0c098b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:54.828575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ced9-5890-4141-abd7-f7c1b0c098b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:54.828869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ced9-5890-4141-abd7-f7c1b0c098b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:54.829846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ced9-5890-4141-abd7-f7c1b0c098b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:54.829846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02ced9-5890-4141-abd7-f7c1b0c098b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:54.831831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02ced9-5890-4141-abd7-f7c1b0c098b9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:54.860991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1167/2338] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:03:54 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:54.864939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:54.876122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63399d2-9177-454d-a424-451f21ab5745 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:54.930679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752bf2e-7447-4506-9be5-42ea02738614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:54.931384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752bf2e-7447-4506-9be5-42ea02738614 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:54.931670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752bf2e-7447-4506-9be5-42ea02738614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:54.931945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752bf2e-7447-4506-9be5-42ea02738614 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:54.932626 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752bf2e-7447-4506-9be5-42ea02738614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:54.934576 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752bf2e-7447-4506-9be5-42ea02738614 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:54.954902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1172/2339] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:03:54 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:03:54.958974 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ced9-5890-4141-abd7-f7c1b0c098b9 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:54.969382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ced9-5890-4141-abd7-f7c1b0c098b9 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:54.973922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492beee-cd0c-4116-b2b7-ffb835139536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:54.974566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492beee-cd0c-4116-b2b7-ffb835139536 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:54.974840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492beee-cd0c-4116-b2b7-ffb835139536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:54.975104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492beee-cd0c-4116-b2b7-ffb835139536 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:54.975902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492beee-cd0c-4116-b2b7-ffb835139536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:54.977472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492beee-cd0c-4116-b2b7-ffb835139536 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:54.987969 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1168/2340] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:54.991731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752bf2e-7447-4506-9be5-42ea02738614 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.001704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752bf2e-7447-4506-9be5-42ea02738614 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:55.006446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869815d6-0dab-4e36-a2b2-e8730e5d94e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:55.007120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869815d6-0dab-4e36-a2b2-e8730e5d94e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.007423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869815d6-0dab-4e36-a2b2-e8730e5d94e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.007695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869815d6-0dab-4e36-a2b2-e8730e5d94e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.008406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869815d6-0dab-4e36-a2b2-e8730e5d94e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:55.010075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869815d6-0dab-4e36-a2b2-e8730e5d94e7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:55.020380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1173/2341] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:55.024440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492beee-cd0c-4116-b2b7-ffb835139536 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.037434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492beee-cd0c-4116-b2b7-ffb835139536 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:55.044557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410ba3b-baf0-4469-8216-49ef16641166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:55.044708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ba3b-baf0-4469-8216-49ef16641166 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.045011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ba3b-baf0-4469-8216-49ef16641166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.045235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410ba3b-baf0-4469-8216-49ef16641166 admin admin] PATH_INFO: `/v3/projects/0cc4aa4d6cca410ba0d69b2eeeea276e/users/723f909859c74b52acb0cfa41cf2fac0/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.062485 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410ba3b-baf0-4469-8216-49ef16641166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc4aa4d6cca410ba0d69b2eeeea276e, user_id=723f909859c74b52acb0cfa41cf2fac0, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:55.065264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410ba3b-baf0-4469-8216-49ef16641166 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:55.080776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1169/2342] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:55 2022] PUT /identity/v3/projects/0cc4aa4d6cca410ba0d69b2eeeea276e/users/723f909859c74b52acb0cfa41cf2fac0/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:55.091512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977896-bc2c-4da9-83c3-2110536815b5 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.091804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977896-bc2c-4da9-83c3-2110536815b5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.092134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977896-bc2c-4da9-83c3-2110536815b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.120603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7a977896-bc2c-4da9-83c3-2110536815b5 None None] MFA Rules not processed for user `723f909859c74b52acb0cfa41cf2fac0`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:55.121881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7a977896-bc2c-4da9-83c3-2110536815b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:55.207001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1174/2343] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:55.211214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410ba3b-baf0-4469-8216-49ef16641166 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.273585 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410ba3b-baf0-4469-8216-49ef16641166 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:55.278214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e206b-c390-4389-abfc-4793b8c562c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:55.278869 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e206b-c390-4389-abfc-4793b8c562c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.279149 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e206b-c390-4389-abfc-4793b8c562c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.279450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e206b-c390-4389-abfc-4793b8c562c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.280678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e206b-c390-4389-abfc-4793b8c562c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:55.282867 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e206b-c390-4389-abfc-4793b8c562c1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:55.312116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1170/2344] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:03:55 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:55.315946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977896-bc2c-4da9-83c3-2110536815b5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.332455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977896-bc2c-4da9-83c3-2110536815b5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:55.444121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6916697-b2fd-4454-8a29-5d5d80c729d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:55.445180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6916697-b2fd-4454-8a29-5d5d80c729d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.445695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6916697-b2fd-4454-8a29-5d5d80c729d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.446888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6916697-b2fd-4454-8a29-5d5d80c729d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.448957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6916697-b2fd-4454-8a29-5d5d80c729d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:55.451156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6916697-b2fd-4454-8a29-5d5d80c729d7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:55.504572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1175/2345] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:03:55 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:55.508860 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e206b-c390-4389-abfc-4793b8c562c1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.521260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e206b-c390-4389-abfc-4793b8c562c1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:55.526646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c09383-9bda-4d39-9dc8-54a5bc4b55fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:55.527703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09383-9bda-4d39-9dc8-54a5bc4b55fd admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.528232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09383-9bda-4d39-9dc8-54a5bc4b55fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.528719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09383-9bda-4d39-9dc8-54a5bc4b55fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.529738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c09383-9bda-4d39-9dc8-54a5bc4b55fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:55.531723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c09383-9bda-4d39-9dc8-54a5bc4b55fd admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:55.548528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1171/2346] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:55.553555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6916697-b2fd-4454-8a29-5d5d80c729d7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.567731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6916697-b2fd-4454-8a29-5d5d80c729d7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:55.580439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799af17-3ebf-43cf-8e21-0003508c00f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:55.581353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799af17-3ebf-43cf-8e21-0003508c00f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.581627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799af17-3ebf-43cf-8e21-0003508c00f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.581897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799af17-3ebf-43cf-8e21-0003508c00f1 admin admin] PATH_INFO: `/v3/projects/dc526dca2cdf4a16bddc18ddaa8d5011/users/ef6fdac57cbf42fc8a7b3c6943792a91/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.607767 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799af17-3ebf-43cf-8e21-0003508c00f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc526dca2cdf4a16bddc18ddaa8d5011, user_id=ef6fdac57cbf42fc8a7b3c6943792a91, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:55.613985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799af17-3ebf-43cf-8e21-0003508c00f1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:55.638641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c09383-9bda-4d39-9dc8-54a5bc4b55fd admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.639491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1176/2347] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:55 2022] PUT /identity/v3/projects/dc526dca2cdf4a16bddc18ddaa8d5011/users/ef6fdac57cbf42fc8a7b3c6943792a91/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:55.652487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c09383-9bda-4d39-9dc8-54a5bc4b55fd admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:55.724015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4137b-2caf-42fc-8168-9367e4c224fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:55.724748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4137b-2caf-42fc-8168-9367e4c224fc admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.725036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4137b-2caf-42fc-8168-9367e4c224fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.725308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4137b-2caf-42fc-8168-9367e4c224fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.726131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4137b-2caf-42fc-8168-9367e4c224fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:55.729911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4137b-2caf-42fc-8168-9367e4c224fc admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:55.743877 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1172/2348] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:55.748774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799af17-3ebf-43cf-8e21-0003508c00f1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.761423 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799af17-3ebf-43cf-8e21-0003508c00f1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:55.767085 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:55.768933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.768933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.769185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] PATH_INFO: `/v3/projects/dc526dca2cdf4a16bddc18ddaa8d5011/users/ef6fdac57cbf42fc8a7b3c6943792a91/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.771122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc526dca2cdf4a16bddc18ddaa8d5011, user_id=ef6fdac57cbf42fc8a7b3c6943792a91, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:55.773830 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:55.786143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1177/2349] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:55 2022] PUT /identity/v3/projects/dc526dca2cdf4a16bddc18ddaa8d5011/users/ef6fdac57cbf42fc8a7b3c6943792a91/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:55.798362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3e9a-6624-425b-bd3e-9286a512a7b8 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:55.798792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3e9a-6624-425b-bd3e-9286a512a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:55.799146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3e9a-6624-425b-bd3e-9286a512a7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:55.842879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-357b3e9a-6624-425b-bd3e-9286a512a7b8 None None] MFA Rules not processed for user `ef6fdac57cbf42fc8a7b3c6943792a91`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:55.842879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-357b3e9a-6624-425b-bd3e-9286a512a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:55.910315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1173/2350] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:55.930624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:55.932595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:56.005394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d233-77c3-4eb5-a86c-00708286a89f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:56.013780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe826aa-641c-4d32-9fa5-774aee261c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:56.014491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe826aa-641c-4d32-9fa5-774aee261c54 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:56.014774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe826aa-641c-4d32-9fa5-774aee261c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:56.015087 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe826aa-641c-4d32-9fa5-774aee261c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:56.025788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe826aa-641c-4d32-9fa5-774aee261c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:56.027342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe826aa-641c-4d32-9fa5-774aee261c54 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:56.043568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1178/2351] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:56.619846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3e9a-6624-425b-bd3e-9286a512a7b8 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:56.710415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3e9a-6624-425b-bd3e-9286a512a7b8 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:56.715906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:56.716914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:56.717272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:56.717650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] PATH_INFO: `/v3/users/723f909859c74b52acb0cfa41cf2fac0` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:56.718949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=723f909859c74b52acb0cfa41cf2fac0)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:56.724942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:56.784727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723f909859c74b52acb0cfa41cf2fac0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:56.792908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723f909859c74b52acb0cfa41cf2fac0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:56.793645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723f909859c74b52acb0cfa41cf2fac0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:56.803370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723f909859c74b52acb0cfa41cf2fac0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:56.804469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723f909859c74b52acb0cfa41cf2fac0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:56.831325 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1174/2352] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:03:56 2022] DELETE /identity/v3/users/723f909859c74b52acb0cfa41cf2fac0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:56.836491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f494a94-9187-426a-b2bd-b0223c32b1b3 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:56.837020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f494a94-9187-426a-b2bd-b0223c32b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:56.837020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f494a94-9187-426a-b2bd-b0223c32b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:56.863661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5f494a94-9187-426a-b2bd-b0223c32b1b3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:56.865628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5f494a94-9187-426a-b2bd-b0223c32b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:56.975173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1179/2353] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:56.989214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:56.990940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:57.070081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae7fa7-ac29-4232-a66c-0792ca3cb12b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:57.074121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e95dc5-6416-41a0-a7e1-89e0daa183e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:57.074944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95dc5-6416-41a0-a7e1-89e0daa183e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:57.075562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95dc5-6416-41a0-a7e1-89e0daa183e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:57.075990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95dc5-6416-41a0-a7e1-89e0daa183e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:57.088452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e95dc5-6416-41a0-a7e1-89e0daa183e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:57.090094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e95dc5-6416-41a0-a7e1-89e0daa183e9 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:57.100545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1175/2354] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:57.788944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f494a94-9187-426a-b2bd-b0223c32b1b3 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:57.790594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5f494a94-9187-426a-b2bd-b0223c32b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:57.804181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f494a94-9187-426a-b2bd-b0223c32b1b3 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:57.810927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:57.811874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:57.812926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:57.813262 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] PATH_INFO: `/v3/projects/0cc4aa4d6cca410ba0d69b2eeeea276e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:57.814685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc4aa4d6cca410ba0d69b2eeeea276e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:57.816793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:57.872430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc4aa4d6cca410ba0d69b2eeeea276e', 'request_id': 'req-0f56cb9b-6681-4c0f-b044-56403a91154b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:57.881938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc4aa4d6cca410ba0d69b2eeeea276e', 'request_id': 'req-0f56cb9b-6681-4c0f-b044-56403a91154b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:57.889202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc4aa4d6cca410ba0d69b2eeeea276e', 'request_id': 'req-0f56cb9b-6681-4c0f-b044-56403a91154b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:57.907694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] The token cache is being invalidate because project 0cc4aa4d6cca410ba0d69b2eeeea276e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:03:57.908336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:57.909299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:57.910976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1180/2355] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:03:57 2022] DELETE /identity/v3/projects/0cc4aa4d6cca410ba0d69b2eeeea276e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:57.915939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e95dc5-6416-41a0-a7e1-89e0daa183e9 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:57.927871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e95dc5-6416-41a0-a7e1-89e0daa183e9 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:58.002060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:58.003017 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.003415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.003760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] PATH_INFO: `/v3/users/ef6fdac57cbf42fc8a7b3c6943792a91` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.005048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6fdac57cbf42fc8a7b3c6943792a91)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:58.007038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:58.069077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6fdac57cbf42fc8a7b3c6943792a91'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.078824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6fdac57cbf42fc8a7b3c6943792a91'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.080020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6fdac57cbf42fc8a7b3c6943792a91'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.090653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6fdac57cbf42fc8a7b3c6943792a91'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.092038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3826599a-511d-4977-b125-8cc8f3da5bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6fdac57cbf42fc8a7b3c6943792a91'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.117283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1176/2356] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:03:57 2022] DELETE /identity/v3/users/ef6fdac57cbf42fc8a7b3c6943792a91 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:58.395067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:58.396569 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:58.409871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56cb9b-6681-4c0f-b044-56403a91154b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:58.465559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:58.466414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.466696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.466978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] PATH_INFO: `/v3/projects/dc526dca2cdf4a16bddc18ddaa8d5011` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.468796 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc526dca2cdf4a16bddc18ddaa8d5011)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:58.470699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:58.513202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc526dca2cdf4a16bddc18ddaa8d5011', 'request_id': 'req-61d76440-ca97-4664-bb2d-142e940f0eea'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.521465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc526dca2cdf4a16bddc18ddaa8d5011', 'request_id': 'req-61d76440-ca97-4664-bb2d-142e940f0eea'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.526973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc526dca2cdf4a16bddc18ddaa8d5011', 'request_id': 'req-61d76440-ca97-4664-bb2d-142e940f0eea'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.538387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] The token cache is being invalidate because project dc526dca2cdf4a16bddc18ddaa8d5011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:03:58.538672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.539312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-61d76440-ca97-4664-bb2d-142e940f0eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:03:58.540879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1181/2357] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:03:58 2022] DELETE /identity/v3/projects/dc526dca2cdf4a16bddc18ddaa8d5011 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:03:58.545817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f577d5-8a53-4142-90d8-4421a950a93f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.546106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f577d5-8a53-4142-90d8-4421a950a93f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.546386 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f577d5-8a53-4142-90d8-4421a950a93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.563587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-46f577d5-8a53-4142-90d8-4421a950a93f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:58.564711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-46f577d5-8a53-4142-90d8-4421a950a93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:58.622327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1177/2358] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:58.630192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047d328-a9d6-4e97-8c25-10c6917806d5 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.630500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047d328-a9d6-4e97-8c25-10c6917806d5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.630768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047d328-a9d6-4e97-8c25-10c6917806d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.648934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b047d328-a9d6-4e97-8c25-10c6917806d5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:58.650121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b047d328-a9d6-4e97-8c25-10c6917806d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:58.658537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1182/2359] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:58.662779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f577d5-8a53-4142-90d8-4421a950a93f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:58.672377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f577d5-8a53-4142-90d8-4421a950a93f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:58.676906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:58.677552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.677832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.678103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.678814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:03:58.679119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:58.680745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:58.692172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1178/2360] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:03:58.696799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047d328-a9d6-4e97-8c25-10c6917806d5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:58.706486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047d328-a9d6-4e97-8c25-10c6917806d5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:58.711038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ba669-9546-49d0-8ab0-7eecd667fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:58.711708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ba669-9546-49d0-8ab0-7eecd667fae7 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.711984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ba669-9546-49d0-8ab0-7eecd667fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.712251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ba669-9546-49d0-8ab0-7eecd667fae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.712933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ba669-9546-49d0-8ab0-7eecd667fae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:58.714811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ba669-9546-49d0-8ab0-7eecd667fae7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:58.739887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1183/2361] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:03:58 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:03:58.744006 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:58.753726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605b813-9440-411d-adcc-051c5780b796 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:58.807443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319f35-f59f-4f0c-bbe1-a51b636b2b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:58.808097 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319f35-f59f-4f0c-bbe1-a51b636b2b0a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.808378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319f35-f59f-4f0c-bbe1-a51b636b2b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.808658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319f35-f59f-4f0c-bbe1-a51b636b2b0a admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.809336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319f35-f59f-4f0c-bbe1-a51b636b2b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:58.811782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319f35-f59f-4f0c-bbe1-a51b636b2b0a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:58.831397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1179/2362] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:03:58 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:58.835586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ba669-9546-49d0-8ab0-7eecd667fae7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:58.845664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ba669-9546-49d0-8ab0-7eecd667fae7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:58.850366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426926d-f843-4658-9f91-6e72e533e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:58.851020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426926d-f843-4658-9f91-6e72e533e9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.851318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426926d-f843-4658-9f91-6e72e533e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.851616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426926d-f843-4658-9f91-6e72e533e9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.852341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426926d-f843-4658-9f91-6e72e533e9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:58.853959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426926d-f843-4658-9f91-6e72e533e9f4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:58.864522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1184/2363] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:58.868663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319f35-f59f-4f0c-bbe1-a51b636b2b0a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:58.878933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319f35-f59f-4f0c-bbe1-a51b636b2b0a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:58.883434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48330fc2-46a1-4559-b34c-c41f15ca555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:58.884072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48330fc2-46a1-4559-b34c-c41f15ca555b admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.884347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48330fc2-46a1-4559-b34c-c41f15ca555b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.884614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48330fc2-46a1-4559-b34c-c41f15ca555b admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.885330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48330fc2-46a1-4559-b34c-c41f15ca555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:58.886894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48330fc2-46a1-4559-b34c-c41f15ca555b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:58.897106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1180/2364] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:58.901018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426926d-f843-4658-9f91-6e72e533e9f4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:58.910712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426926d-f843-4658-9f91-6e72e533e9f4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:58.915252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad6062-d4ac-413f-8086-ce53052bc922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:58.916145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6062-d4ac-413f-8086-ce53052bc922 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.916424 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6062-d4ac-413f-8086-ce53052bc922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.916694 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6062-d4ac-413f-8086-ce53052bc922 admin admin] PATH_INFO: `/v3/projects/ec0482aaae254befb1710c199764556e/users/ac7e83bc42c94be8a52154785df92b05/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.930464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad6062-d4ac-413f-8086-ce53052bc922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0482aaae254befb1710c199764556e, user_id=ac7e83bc42c94be8a52154785df92b05, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:58.933180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad6062-d4ac-413f-8086-ce53052bc922 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:58.946841 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1185/2365] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:58 2022] PUT /identity/v3/projects/ec0482aaae254befb1710c199764556e/users/ac7e83bc42c94be8a52154785df92b05/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:03:58.958568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d77e2-8c95-421f-bd89-90472cbfd085 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:58.959062 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d77e2-8c95-421f-bd89-90472cbfd085 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:58.959171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d77e2-8c95-421f-bd89-90472cbfd085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:58.985273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b46d77e2-8c95-421f-bd89-90472cbfd085 None None] MFA Rules not processed for user `ac7e83bc42c94be8a52154785df92b05`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:58.986486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b46d77e2-8c95-421f-bd89-90472cbfd085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:59.058164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1181/2366] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:03:59.059468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad6062-d4ac-413f-8086-ce53052bc922 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:59.130980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad6062-d4ac-413f-8086-ce53052bc922 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:59.136470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95dc74-20be-411a-ad03-57b3d0f7a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:59.137385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95dc74-20be-411a-ad03-57b3d0f7a008 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.138391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95dc74-20be-411a-ad03-57b3d0f7a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.140748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95dc74-20be-411a-ad03-57b3d0f7a008 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.141571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95dc74-20be-411a-ad03-57b3d0f7a008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:59.143609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95dc74-20be-411a-ad03-57b3d0f7a008 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:59.174235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1186/2367] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:03:59 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:59.175375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d77e2-8c95-421f-bd89-90472cbfd085 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:59.185817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d77e2-8c95-421f-bd89-90472cbfd085 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:59.243127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92704a2-0da9-433d-8a4e-a644e9f1c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:59.243836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92704a2-0da9-433d-8a4e-a644e9f1c6bf admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.244116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92704a2-0da9-433d-8a4e-a644e9f1c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.244390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92704a2-0da9-433d-8a4e-a644e9f1c6bf admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.245075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92704a2-0da9-433d-8a4e-a644e9f1c6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:59.246990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92704a2-0da9-433d-8a4e-a644e9f1c6bf admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:59.269464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1182/2368] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:03:59 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:03:59.270891 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95dc74-20be-411a-ad03-57b3d0f7a008 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:59.280976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95dc74-20be-411a-ad03-57b3d0f7a008 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:59.285572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c24194-6455-4071-a1dc-0d59a6d5bcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:59.286219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24194-6455-4071-a1dc-0d59a6d5bcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.286494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24194-6455-4071-a1dc-0d59a6d5bcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.286763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24194-6455-4071-a1dc-0d59a6d5bcb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.287508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c24194-6455-4071-a1dc-0d59a6d5bcb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:59.289084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c24194-6455-4071-a1dc-0d59a6d5bcb9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:59.300088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1187/2369] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:59.304211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92704a2-0da9-433d-8a4e-a644e9f1c6bf admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:59.314891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92704a2-0da9-433d-8a4e-a644e9f1c6bf admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:59.319695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e03c7a-ae92-4683-af58-0f78147842bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:59.320598 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03c7a-ae92-4683-af58-0f78147842bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.320871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03c7a-ae92-4683-af58-0f78147842bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.321137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03c7a-ae92-4683-af58-0f78147842bc admin admin] PATH_INFO: `/v3/projects/29bad93a48044d52a8603dc4b15b9eb3/users/aa9f336cf2d845f389bfcc3ed31fbb08/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.335709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e03c7a-ae92-4683-af58-0f78147842bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bad93a48044d52a8603dc4b15b9eb3, user_id=aa9f336cf2d845f389bfcc3ed31fbb08, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:59.338674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e03c7a-ae92-4683-af58-0f78147842bc admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:59.351871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1183/2370] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:59 2022] PUT /identity/v3/projects/29bad93a48044d52a8603dc4b15b9eb3/users/aa9f336cf2d845f389bfcc3ed31fbb08/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:59.355739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c24194-6455-4071-a1dc-0d59a6d5bcb9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:59.366178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c24194-6455-4071-a1dc-0d59a6d5bcb9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:59.421602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5d1c5-f575-4c79-885d-40400955cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:59.422273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5d1c5-f575-4c79-885d-40400955cba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.422555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5d1c5-f575-4c79-885d-40400955cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.422833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5d1c5-f575-4c79-885d-40400955cba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.423616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5d1c5-f575-4c79-885d-40400955cba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:59.425219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5d1c5-f575-4c79-885d-40400955cba2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:59.435492 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1188/2371] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:03:59.440163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e03c7a-ae92-4683-af58-0f78147842bc admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:59.450740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e03c7a-ae92-4683-af58-0f78147842bc admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:59.455267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:59.456166 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.456441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.456708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] PATH_INFO: `/v3/projects/29bad93a48044d52a8603dc4b15b9eb3/users/aa9f336cf2d845f389bfcc3ed31fbb08/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.458653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bad93a48044d52a8603dc4b15b9eb3, user_id=aa9f336cf2d845f389bfcc3ed31fbb08, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:59.461284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:59.476594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1184/2372] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:03:59 2022] PUT /identity/v3/projects/29bad93a48044d52a8603dc4b15b9eb3/users/aa9f336cf2d845f389bfcc3ed31fbb08/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:03:59.487143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e1f4-b631-4b22-a17a-86d811b2f468 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.487466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e1f4-b631-4b22-a17a-86d811b2f468 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.487775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e1f4-b631-4b22-a17a-86d811b2f468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.517864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-2744e1f4-b631-4b22-a17a-86d811b2f468 None None] MFA Rules not processed for user `aa9f336cf2d845f389bfcc3ed31fbb08`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:03:59.519155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2744e1f4-b631-4b22-a17a-86d811b2f468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:59.590138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1189/2373] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:03:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:03:59.601669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:59.603411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:03:59.658630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45434dc-8c66-4ca8-90ed-cd4eb1e69f28 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:59.662394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e906be-e1e1-4b48-84ca-a90340f8c365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:59.663026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e906be-e1e1-4b48-84ca-a90340f8c365 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.663313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e906be-e1e1-4b48-84ca-a90340f8c365 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.663686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e906be-e1e1-4b48-84ca-a90340f8c365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.673294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e906be-e1e1-4b48-84ca-a90340f8c365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:59.674695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e906be-e1e1-4b48-84ca-a90340f8c365 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:59.683880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1185/2374] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:03:59.754596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e1f4-b631-4b22-a17a-86d811b2f468 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:03:59.763904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e1f4-b631-4b22-a17a-86d811b2f468 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:03:59.767659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bddaa-7915-41eb-99ef-1d37f79bcae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:03:59.768281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bddaa-7915-41eb-99ef-1d37f79bcae2 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:03:59.768557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bddaa-7915-41eb-99ef-1d37f79bcae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:03:59.768828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bddaa-7915-41eb-99ef-1d37f79bcae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:03:59.823406 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bddaa-7915-41eb-99ef-1d37f79bcae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:03:59.824850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bddaa-7915-41eb-99ef-1d37f79bcae2 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:03:59.833669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1190/2375] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:03:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:09.008582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e906be-e1e1-4b48-84ca-a90340f8c365 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:09.069785 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e906be-e1e1-4b48-84ca-a90340f8c365 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:09.075163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:09.076190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:09.076477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:09.076764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] PATH_INFO: `/v3/users/ac7e83bc42c94be8a52154785df92b05` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:09.078497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7e83bc42c94be8a52154785df92b05)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:09.080463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:09.127573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7e83bc42c94be8a52154785df92b05'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.134134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7e83bc42c94be8a52154785df92b05'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.134781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7e83bc42c94be8a52154785df92b05'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.142204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7e83bc42c94be8a52154785df92b05'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.142812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7e83bc42c94be8a52154785df92b05'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.160589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1186/2376] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:09 2022] DELETE /identity/v3/users/ac7e83bc42c94be8a52154785df92b05 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:09.165144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09fb33-4ac4-4e6c-af2c-bc08da403932 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:09.165640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09fb33-4ac4-4e6c-af2c-bc08da403932 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:09.165763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09fb33-4ac4-4e6c-af2c-bc08da403932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:09.184624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0f09fb33-4ac4-4e6c-af2c-bc08da403932 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:09.185814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0f09fb33-4ac4-4e6c-af2c-bc08da403932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:09.261305 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1191/2377] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:04:09.273837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:09.275235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:09.340203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844510d8-022e-4ff0-b25f-4e03c4884c91 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:09.344303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7f4cc-45dd-44a5-8861-9e626ead9a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:09.344966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7f4cc-45dd-44a5-8861-9e626ead9a9b service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:09.345244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7f4cc-45dd-44a5-8861-9e626ead9a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:09.345547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7f4cc-45dd-44a5-8861-9e626ead9a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:09.355546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7f4cc-45dd-44a5-8861-9e626ead9a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:09.356997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7f4cc-45dd-44a5-8861-9e626ead9a9b service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:09.366844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1187/2378] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:09.636625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09fb33-4ac4-4e6c-af2c-bc08da403932 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:09.638279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0f09fb33-4ac4-4e6c-af2c-bc08da403932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:09.659358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09fb33-4ac4-4e6c-af2c-bc08da403932 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:09.670174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:09.671180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:09.671484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:09.671761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] PATH_INFO: `/v3/projects/ec0482aaae254befb1710c199764556e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:09.673082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0482aaae254befb1710c199764556e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:09.674997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:09.730867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0482aaae254befb1710c199764556e', 'request_id': 'req-c7630fdb-2fd8-4b3c-909c-422e6045c978'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.742616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0482aaae254befb1710c199764556e', 'request_id': 'req-c7630fdb-2fd8-4b3c-909c-422e6045c978'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.749079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0482aaae254befb1710c199764556e', 'request_id': 'req-c7630fdb-2fd8-4b3c-909c-422e6045c978'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.761017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] The token cache is being invalidate because project ec0482aaae254befb1710c199764556e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:09.761301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.762091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.763693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1192/2379] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:09 2022] DELETE /identity/v3/projects/ec0482aaae254befb1710c199764556e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:09.769475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7f4cc-45dd-44a5-8861-9e626ead9a9b service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:09.789886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7f4cc-45dd-44a5-8861-9e626ead9a9b service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:09.856321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:09.857260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:09.857532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:09.857799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] PATH_INFO: `/v3/users/aa9f336cf2d845f389bfcc3ed31fbb08` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:09.859056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9f336cf2d845f389bfcc3ed31fbb08)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:09.861016 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:09.916085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9f336cf2d845f389bfcc3ed31fbb08'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.928056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9f336cf2d845f389bfcc3ed31fbb08'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.928830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9f336cf2d845f389bfcc3ed31fbb08'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.939612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9f336cf2d845f389bfcc3ed31fbb08'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.940839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c89a48a-085e-4297-8152-d3e5239280d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9f336cf2d845f389bfcc3ed31fbb08'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:09.967118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1188/2380] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:09 2022] DELETE /identity/v3/users/aa9f336cf2d845f389bfcc3ed31fbb08 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:10.242348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:10.244268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:10.258499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7630fdb-2fd8-4b3c-909c-422e6045c978 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:10.315329 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:10.316190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.316473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.316742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] PATH_INFO: `/v3/projects/29bad93a48044d52a8603dc4b15b9eb3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.317896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29bad93a48044d52a8603dc4b15b9eb3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:10.320095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:10.365269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29bad93a48044d52a8603dc4b15b9eb3', 'request_id': 'req-8b537286-3a3a-4406-8e85-f95c0777272b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:10.372026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29bad93a48044d52a8603dc4b15b9eb3', 'request_id': 'req-8b537286-3a3a-4406-8e85-f95c0777272b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:10.377553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29bad93a48044d52a8603dc4b15b9eb3', 'request_id': 'req-8b537286-3a3a-4406-8e85-f95c0777272b'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:10.388375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] The token cache is being invalidate because project 29bad93a48044d52a8603dc4b15b9eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:10.388659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:10.389372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8b537286-3a3a-4406-8e85-f95c0777272b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:10.391585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1193/2381] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:10 2022] DELETE /identity/v3/projects/29bad93a48044d52a8603dc4b15b9eb3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:10.396331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332810c1-7147-48e1-8428-da83b4200143 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.396801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332810c1-7147-48e1-8428-da83b4200143 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.397000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332810c1-7147-48e1-8428-da83b4200143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.414664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-332810c1-7147-48e1-8428-da83b4200143 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:10.416014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-332810c1-7147-48e1-8428-da83b4200143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:10.475288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1189/2382] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:10.482821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae304-3c9b-44ab-af6e-ae69a28e5f76 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.483109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae304-3c9b-44ab-af6e-ae69a28e5f76 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.483422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae304-3c9b-44ab-af6e-ae69a28e5f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.501258 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7beae304-3c9b-44ab-af6e-ae69a28e5f76 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:10.502475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7beae304-3c9b-44ab-af6e-ae69a28e5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:10.510996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1194/2383] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:10.515651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332810c1-7147-48e1-8428-da83b4200143 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:10.525802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332810c1-7147-48e1-8428-da83b4200143 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:10.530700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:10.531534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.531813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.532083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.532802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:04:10.533104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:10.534694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:10.547399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1190/2384] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:04:10.551743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae304-3c9b-44ab-af6e-ae69a28e5f76 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:10.561011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae304-3c9b-44ab-af6e-ae69a28e5f76 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:10.566761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce05ff5-a361-412c-9076-babf28c0727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:10.567564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce05ff5-a361-412c-9076-babf28c0727a admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.567908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce05ff5-a361-412c-9076-babf28c0727a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.568167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce05ff5-a361-412c-9076-babf28c0727a admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.569099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce05ff5-a361-412c-9076-babf28c0727a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:10.571044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce05ff5-a361-412c-9076-babf28c0727a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:10.599380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1195/2385] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:10 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:10.600567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:10.611267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62699d5-166b-4337-9c89-ba6cc1f47b8d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:10.667524 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b7d7c-b8c9-4722-aea5-ea0d35c29135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:10.668200 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7d7c-b8c9-4722-aea5-ea0d35c29135 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.668480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7d7c-b8c9-4722-aea5-ea0d35c29135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.668784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7d7c-b8c9-4722-aea5-ea0d35c29135 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.669498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b7d7c-b8c9-4722-aea5-ea0d35c29135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:10.672007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b7d7c-b8c9-4722-aea5-ea0d35c29135 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:10.693172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1191/2386] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:10 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:10.697640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce05ff5-a361-412c-9076-babf28c0727a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:10.708077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce05ff5-a361-412c-9076-babf28c0727a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:10.712771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28245136-19bc-445f-aaf8-303409b07a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:10.713428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245136-19bc-445f-aaf8-303409b07a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.713709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245136-19bc-445f-aaf8-303409b07a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.713982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245136-19bc-445f-aaf8-303409b07a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.714708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28245136-19bc-445f-aaf8-303409b07a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:10.716364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28245136-19bc-445f-aaf8-303409b07a8a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:10.727837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1196/2387] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:04:10.731895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b7d7c-b8c9-4722-aea5-ea0d35c29135 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:10.742151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b7d7c-b8c9-4722-aea5-ea0d35c29135 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:10.746934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878382bb-8d3d-4976-bfa7-82b95ee802f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:10.747772 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878382bb-8d3d-4976-bfa7-82b95ee802f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.748059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878382bb-8d3d-4976-bfa7-82b95ee802f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.748338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878382bb-8d3d-4976-bfa7-82b95ee802f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.749067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878382bb-8d3d-4976-bfa7-82b95ee802f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:10.751239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878382bb-8d3d-4976-bfa7-82b95ee802f2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:10.761264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1192/2388] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:10.765387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28245136-19bc-445f-aaf8-303409b07a8a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:10.775224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28245136-19bc-445f-aaf8-303409b07a8a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:10.779908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4a766-8420-437a-8930-0e071446a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:10.781315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4a766-8420-437a-8930-0e071446a208 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.781590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4a766-8420-437a-8930-0e071446a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.781861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4a766-8420-437a-8930-0e071446a208 admin admin] PATH_INFO: `/v3/projects/15a88297649843b8a4866f206cca5fc9/users/dc6e3530608341beb3f52b77ef7a6b4e/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.797852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4a766-8420-437a-8930-0e071446a208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a88297649843b8a4866f206cca5fc9, user_id=dc6e3530608341beb3f52b77ef7a6b4e, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:10.800556 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4a766-8420-437a-8930-0e071446a208 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:10.814012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1197/2389] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:10 2022] PUT /identity/v3/projects/15a88297649843b8a4866f206cca5fc9/users/dc6e3530608341beb3f52b77ef7a6b4e/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:04:10.825634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044120c-8cfd-4b3e-af9b-3776ec65bb51 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:10.826007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044120c-8cfd-4b3e-af9b-3776ec65bb51 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:10.826345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044120c-8cfd-4b3e-af9b-3776ec65bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:10.861370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b044120c-8cfd-4b3e-af9b-3776ec65bb51 None None] MFA Rules not processed for user `dc6e3530608341beb3f52b77ef7a6b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:10.863582 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b044120c-8cfd-4b3e-af9b-3776ec65bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:10.938298 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1193/2390] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:10.943200 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4a766-8420-437a-8930-0e071446a208 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:11.016444 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4a766-8420-437a-8930-0e071446a208 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:11.021381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86aa65-4ca4-477e-a016-0dd8ba4b1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:11.022047 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86aa65-4ca4-477e-a016-0dd8ba4b1a84 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:11.022331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86aa65-4ca4-477e-a016-0dd8ba4b1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:11.022605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86aa65-4ca4-477e-a016-0dd8ba4b1a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:11.023312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86aa65-4ca4-477e-a016-0dd8ba4b1a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:11.025234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86aa65-4ca4-477e-a016-0dd8ba4b1a84 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:11.056014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1198/2391] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:10 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:11.060231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044120c-8cfd-4b3e-af9b-3776ec65bb51 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:11.074332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044120c-8cfd-4b3e-af9b-3776ec65bb51 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:11.156561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd144-a965-4ca4-a106-6d04351ff7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:11.157620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd144-a965-4ca4-a106-6d04351ff7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:11.157903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd144-a965-4ca4-a106-6d04351ff7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:11.158175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd144-a965-4ca4-a106-6d04351ff7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:11.158948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afd144-a965-4ca4-a106-6d04351ff7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:11.160971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afd144-a965-4ca4-a106-6d04351ff7a8 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:11.183797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1194/2392] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:11 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:11.192664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86aa65-4ca4-477e-a016-0dd8ba4b1a84 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:11.207194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86aa65-4ca4-477e-a016-0dd8ba4b1a84 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:11.212902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d11b6-5d6b-4cb3-9cdb-5a61bd0d2e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:11.213841 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d11b6-5d6b-4cb3-9cdb-5a61bd0d2e2a admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:11.214124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d11b6-5d6b-4cb3-9cdb-5a61bd0d2e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:11.214522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d11b6-5d6b-4cb3-9cdb-5a61bd0d2e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:11.215259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d11b6-5d6b-4cb3-9cdb-5a61bd0d2e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:11.216890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d11b6-5d6b-4cb3-9cdb-5a61bd0d2e2a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:11.230031 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1199/2393] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:11.234289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd144-a965-4ca4-a106-6d04351ff7a8 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:11.245833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd144-a965-4ca4-a106-6d04351ff7a8 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:11.250829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be603-16fd-4483-98a8-4fa509834ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:11.251759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be603-16fd-4483-98a8-4fa509834ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:11.252040 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be603-16fd-4483-98a8-4fa509834ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:11.252317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be603-16fd-4483-98a8-4fa509834ad7 admin admin] PATH_INFO: `/v3/projects/092c75cdbdf34231934a5a49b9ab58f9/users/f61210f40dd74ba2a59362e25a44b6fd/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:11.270344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8be603-16fd-4483-98a8-4fa509834ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092c75cdbdf34231934a5a49b9ab58f9, user_id=f61210f40dd74ba2a59362e25a44b6fd, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:11.273115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8be603-16fd-4483-98a8-4fa509834ad7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:11.291130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1195/2394] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:11 2022] PUT /identity/v3/projects/092c75cdbdf34231934a5a49b9ab58f9/users/f61210f40dd74ba2a59362e25a44b6fd/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:11.293128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d11b6-5d6b-4cb3-9cdb-5a61bd0d2e2a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:11.304433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d11b6-5d6b-4cb3-9cdb-5a61bd0d2e2a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:11.364828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dfc70-3960-4018-9f81-e2f71028b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:11.365508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dfc70-3960-4018-9f81-e2f71028b5ce admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:11.365794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dfc70-3960-4018-9f81-e2f71028b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:11.366063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dfc70-3960-4018-9f81-e2f71028b5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:11.366791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dfc70-3960-4018-9f81-e2f71028b5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:11.368467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dfc70-3960-4018-9f81-e2f71028b5ce admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:11.379916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1200/2395] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:11.384021 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be603-16fd-4483-98a8-4fa509834ad7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:11.395220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be603-16fd-4483-98a8-4fa509834ad7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:11.400080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:11.400981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:11.401251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:11.401515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] PATH_INFO: `/v3/projects/092c75cdbdf34231934a5a49b9ab58f9/users/f61210f40dd74ba2a59362e25a44b6fd/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:11.403816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092c75cdbdf34231934a5a49b9ab58f9, user_id=f61210f40dd74ba2a59362e25a44b6fd, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:11.406998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:11.431435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1196/2396] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:11 2022] PUT /identity/v3/projects/092c75cdbdf34231934a5a49b9ab58f9/users/f61210f40dd74ba2a59362e25a44b6fd/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:11.434318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ffa8c-3fa8-4091-97dd-bf9b46dcf908 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:11.434629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ffa8c-3fa8-4091-97dd-bf9b46dcf908 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:11.434955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ffa8c-3fa8-4091-97dd-bf9b46dcf908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:11.468985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0f1ffa8c-3fa8-4091-97dd-bf9b46dcf908 None None] MFA Rules not processed for user `f61210f40dd74ba2a59362e25a44b6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:11.470276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0f1ffa8c-3fa8-4091-97dd-bf9b46dcf908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:11.551362 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1201/2397] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:11.559449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:11.561328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:11.635965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efeec4f-4320-4314-9839-1a2c39933a73 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:11.640774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f781-303f-4be1-88ef-a051e116b5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:11.642952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f781-303f-4be1-88ef-a051e116b5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:11.643428 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f781-303f-4be1-88ef-a051e116b5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:11.643855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f781-303f-4be1-88ef-a051e116b5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:11.655139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379f781-303f-4be1-88ef-a051e116b5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:11.656903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379f781-303f-4be1-88ef-a051e116b5d3 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:11.670051 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1197/2398] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:12.020251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ffa8c-3fa8-4091-97dd-bf9b46dcf908 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:12.029477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ffa8c-3fa8-4091-97dd-bf9b46dcf908 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:12.034785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f61210f40dd74ba2a59362e25a44b6fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092c75cdbdf34231934a5a49b9ab58f9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:12.035467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:12.035758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:12.036038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:12.036761 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:04:12.037074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:12.038689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:12.052530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1202/2399] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:04:12.056295 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f781-303f-4be1-88ef-a051e116b5d3 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:12.066960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f781-303f-4be1-88ef-a051e116b5d3 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:12.072356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29371b-5588-4301-8de0-f204ae3ef0d0 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f61210f40dd74ba2a59362e25a44b6fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092c75cdbdf34231934a5a49b9ab58f9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:12.073055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29371b-5588-4301-8de0-f204ae3ef0d0 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:12.073657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29371b-5588-4301-8de0-f204ae3ef0d0 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:12.073657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29371b-5588-4301-8de0-f204ae3ef0d0 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:12.074300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29371b-5588-4301-8de0-f204ae3ef0d0 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:12.079331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29371b-5588-4301-8de0-f204ae3ef0d0 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:12.114533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1198/2400] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:12 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:12.116455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:12.131222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3428a-fe5d-4db6-8fd1-e5ed26bb230d tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:12.213917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f61210f40dd74ba2a59362e25a44b6fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092c75cdbdf34231934a5a49b9ab58f9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:12.214968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:12.214968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:12.215176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:12.215946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:04:12.216257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:12.225780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:12.246063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1203/2401] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:04:12.287594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29371b-5588-4301-8de0-f204ae3ef0d0 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:12.303380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29371b-5588-4301-8de0-f204ae3ef0d0 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:12.308204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f61210f40dd74ba2a59362e25a44b6fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092c75cdbdf34231934a5a49b9ab58f9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:12.309532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:12.309892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:12.310237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] PATH_INFO: `/v3/projects/46e1f30adfc947068668699c97cf1ce3` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:12.312290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=46e1f30adfc947068668699c97cf1ce3)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:12.314497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:12.380189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e1f30adfc947068668699c97cf1ce3', 'request_id': 'req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.389762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e1f30adfc947068668699c97cf1ce3', 'request_id': 'req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.411576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e1f30adfc947068668699c97cf1ce3', 'request_id': 'req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.438971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] The token cache is being invalidate because project 46e1f30adfc947068668699c97cf1ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:12.439274 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.439999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4bf026cf-bc06-4c96-bd8d-a4f131ca35f7 tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.445655 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1199/2402] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:12 2022] DELETE /identity/v3/projects/46e1f30adfc947068668699c97cf1ce3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:12.670205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:12.673338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:12.749994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe8fb-7591-42a2-a256-8a5ff8545f9b tempest-VolumeQuotaClassesTest-1004348730 tempest-VolumeQuotaClassesTest-1004348730-project-admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:12.813583 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:12.814478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:12.814759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:12.815066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] PATH_INFO: `/v3/users/dc6e3530608341beb3f52b77ef7a6b4e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:12.816372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6e3530608341beb3f52b77ef7a6b4e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:12.818349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:12.872668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6e3530608341beb3f52b77ef7a6b4e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.880268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6e3530608341beb3f52b77ef7a6b4e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.889253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6e3530608341beb3f52b77ef7a6b4e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.890504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6e3530608341beb3f52b77ef7a6b4e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.903948 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6e3530608341beb3f52b77ef7a6b4e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:12.911416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1204/2403] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:12 2022] DELETE /identity/v3/users/dc6e3530608341beb3f52b77ef7a6b4e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:12.915923 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61621a-becc-4d0f-8ec8-ad0577e1770e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:12.916330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61621a-becc-4d0f-8ec8-ad0577e1770e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:12.916711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61621a-becc-4d0f-8ec8-ad0577e1770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:12.934897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-bf61621a-becc-4d0f-8ec8-ad0577e1770e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:12.936468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bf61621a-becc-4d0f-8ec8-ad0577e1770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:13.003379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1200/2404] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:13.032999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:13.034535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:13.106462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b830-3d8d-4900-be13-9b385a902cf3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:13.109928 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e66b0-40a9-48e9-ab31-55750512c2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:13.110574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e66b0-40a9-48e9-ab31-55750512c2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:13.110859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e66b0-40a9-48e9-ab31-55750512c2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:13.111138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e66b0-40a9-48e9-ab31-55750512c2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:13.120844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e66b0-40a9-48e9-ab31-55750512c2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:13.122298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e66b0-40a9-48e9-ab31-55750512c2a9 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:13.134181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1205/2405] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:13.471319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61621a-becc-4d0f-8ec8-ad0577e1770e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:13.472952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bf61621a-becc-4d0f-8ec8-ad0577e1770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:13.486842 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61621a-becc-4d0f-8ec8-ad0577e1770e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:13.492774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:13.494103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:13.494614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:13.495107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] PATH_INFO: `/v3/projects/15a88297649843b8a4866f206cca5fc9` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:13.496790 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a88297649843b8a4866f206cca5fc9)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:13.499445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:13.593841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a88297649843b8a4866f206cca5fc9', 'request_id': 'req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.605801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a88297649843b8a4866f206cca5fc9', 'request_id': 'req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.618422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a88297649843b8a4866f206cca5fc9', 'request_id': 'req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.632786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] The token cache is being invalidate because project 15a88297649843b8a4866f206cca5fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:13.633129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.633965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.636476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1201/2406] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:13 2022] DELETE /identity/v3/projects/15a88297649843b8a4866f206cca5fc9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:13.641010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e66b0-40a9-48e9-ab31-55750512c2a9 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:13.654914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e66b0-40a9-48e9-ab31-55750512c2a9 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:13.757415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:13.758326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:13.759056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:13.759393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] PATH_INFO: `/v3/users/f61210f40dd74ba2a59362e25a44b6fd` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:13.760670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61210f40dd74ba2a59362e25a44b6fd)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:13.763128 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:13.825038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61210f40dd74ba2a59362e25a44b6fd'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.834152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61210f40dd74ba2a59362e25a44b6fd'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.842811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61210f40dd74ba2a59362e25a44b6fd'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.843747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61210f40dd74ba2a59362e25a44b6fd'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.858443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-11aabc2b-09d4-45f7-9eef-6c33385f015f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61210f40dd74ba2a59362e25a44b6fd'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:13.868619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1206/2407] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:13 2022] DELETE /identity/v3/users/f61210f40dd74ba2a59362e25a44b6fd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:04:14.359971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:14.361918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:14.382262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1711f4-433a-4fbf-bdd4-efcf2fcda393 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:14.387522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fda93-f5b6-4e88-8ffc-ba69d8a19941 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.387804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fda93-f5b6-4e88-8ffc-ba69d8a19941 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.388079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fda93-f5b6-4e88-8ffc-ba69d8a19941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.406337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-753fda93-f5b6-4e88-8ffc-ba69d8a19941 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:14.407494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-753fda93-f5b6-4e88-8ffc-ba69d8a19941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:14.451204 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:14.453199 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.453567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.453912 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] PATH_INFO: `/v3/projects/092c75cdbdf34231934a5a49b9ab58f9` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.455747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=092c75cdbdf34231934a5a49b9ab58f9)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:14.457801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:14.465378 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1207/2408] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 19:04:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:04:14.478765 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fda93-f5b6-4e88-8ffc-ba69d8a19941 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:14.480490 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-753fda93-f5b6-4e88-8ffc-ba69d8a19941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:14.509893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092c75cdbdf34231934a5a49b9ab58f9', 'request_id': 'req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:14.515459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092c75cdbdf34231934a5a49b9ab58f9', 'request_id': 'req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:14.523525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092c75cdbdf34231934a5a49b9ab58f9', 'request_id': 'req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:14.535475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] The token cache is being invalidate because project 092c75cdbdf34231934a5a49b9ab58f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:14.535758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:14.536416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-dc002554-e1af-4ba8-ba7d-bd8c54b86b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:14.537952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1202/2409] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:14 2022] DELETE /identity/v3/projects/092c75cdbdf34231934a5a49b9ab58f9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:14.542449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2d78-319f-4f56-a87f-d74fd28afea6 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.542729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2d78-319f-4f56-a87f-d74fd28afea6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.543001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2d78-319f-4f56-a87f-d74fd28afea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.559945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fda93-f5b6-4e88-8ffc-ba69d8a19941 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:14.561075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d67f2d78-319f-4f56-a87f-d74fd28afea6 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:14.562286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d67f2d78-319f-4f56-a87f-d74fd28afea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:14.618574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:14.619228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.619543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.619820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.621690 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:14.621818 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1203/2410] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:14.629442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec351-62a4-4539-828b-d8db2d58794f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.629844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec351-62a4-4539-828b-d8db2d58794f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.630124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec351-62a4-4539-828b-d8db2d58794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.647571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-824ec351-62a4-4539-828b-d8db2d58794f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:14.649134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-824ec351-62a4-4539-828b-d8db2d58794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:14.658546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1204/2411] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:04:14.662681 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec351-62a4-4539-828b-d8db2d58794f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:14.672218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec351-62a4-4539-828b-d8db2d58794f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:14.676832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:14.677472 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.677758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.678027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.678741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:04:14.679024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:14.679137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:14.680651 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:14.680758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:14.688717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1208/2412] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 19:04:14.692171 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1205/2413] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 19:04:14.696550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:14.707574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ad257-7e2e-43e4-8c4b-36c35cc760c8 service swift] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:14.712420 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93089a70-f2ca-40e8-b5c9-91b97c5b1297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:14.713068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93089a70-f2ca-40e8-b5c9-91b97c5b1297 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.713348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93089a70-f2ca-40e8-b5c9-91b97c5b1297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.713644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93089a70-f2ca-40e8-b5c9-91b97c5b1297 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.714332 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93089a70-f2ca-40e8-b5c9-91b97c5b1297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:14.716941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93089a70-f2ca-40e8-b5c9-91b97c5b1297 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:14.757662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1209/2414] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:14 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:14.761874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:14.772628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3418-6e84-4501-b7db-e44f6305c711 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:14.840187 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ad99-cfce-49af-89d4-a4645449de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:14.840863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ad99-cfce-49af-89d4-a4645449de25 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.841139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ad99-cfce-49af-89d4-a4645449de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.841422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9ad99-cfce-49af-89d4-a4645449de25 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.844495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9ad99-cfce-49af-89d4-a4645449de25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:14.846863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9ad99-cfce-49af-89d4-a4645449de25 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:14.875331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1206/2415] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:14 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:14.880317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93089a70-f2ca-40e8-b5c9-91b97c5b1297 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:14.893926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93089a70-f2ca-40e8-b5c9-91b97c5b1297 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:14.928808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64741582-0844-4af5-a285-12efbf69d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:14.929621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741582-0844-4af5-a285-12efbf69d3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.929904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741582-0844-4af5-a285-12efbf69d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.930176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741582-0844-4af5-a285-12efbf69d3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.930913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64741582-0844-4af5-a285-12efbf69d3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:14.932600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64741582-0844-4af5-a285-12efbf69d3d4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:14.948252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1210/2416] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:14.952903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ad99-cfce-49af-89d4-a4645449de25 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:14.964560 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9ad99-cfce-49af-89d4-a4645449de25 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:14.974088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57447f3f-b2c1-419a-b30a-bd1d0dbce508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:14.974782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447f3f-b2c1-419a-b30a-bd1d0dbce508 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:14.975078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447f3f-b2c1-419a-b30a-bd1d0dbce508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:14.975372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447f3f-b2c1-419a-b30a-bd1d0dbce508 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:14.981250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57447f3f-b2c1-419a-b30a-bd1d0dbce508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:14.981250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57447f3f-b2c1-419a-b30a-bd1d0dbce508 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:14.995286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1207/2417] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:14.999137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64741582-0844-4af5-a285-12efbf69d3d4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:15.014356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64741582-0844-4af5-a285-12efbf69d3d4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:15.022144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a3b5-9af1-43e6-a0bf-9e7eaea813b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:15.023037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a3b5-9af1-43e6-a0bf-9e7eaea813b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.023337 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a3b5-9af1-43e6-a0bf-9e7eaea813b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.023616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a3b5-9af1-43e6-a0bf-9e7eaea813b1 admin admin] PATH_INFO: `/v3/projects/eca810b8505443c797dd3dc2d8dc7bf9/users/57ad7a76950b4a60a94a64bc6a77451f/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.044499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65a3b5-9af1-43e6-a0bf-9e7eaea813b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca810b8505443c797dd3dc2d8dc7bf9, user_id=57ad7a76950b4a60a94a64bc6a77451f, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:15.047204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65a3b5-9af1-43e6-a0bf-9e7eaea813b1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:15.069059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1211/2418] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:14 2022] PUT /identity/v3/projects/eca810b8505443c797dd3dc2d8dc7bf9/users/57ad7a76950b4a60a94a64bc6a77451f/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:15.076191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076ac8-85c0-4b30-834a-5880408f2556 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.076566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076ac8-85c0-4b30-834a-5880408f2556 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.076918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076ac8-85c0-4b30-834a-5880408f2556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.106112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-96076ac8-85c0-4b30-834a-5880408f2556 None None] MFA Rules not processed for user `57ad7a76950b4a60a94a64bc6a77451f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:15.107409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-96076ac8-85c0-4b30-834a-5880408f2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:15.178165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1208/2419] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:15.183583 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a3b5-9af1-43e6-a0bf-9e7eaea813b1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:15.263806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a3b5-9af1-43e6-a0bf-9e7eaea813b1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:15.271342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ae20f-af92-4569-9dc4-248dc65f9a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:15.271342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae20f-af92-4569-9dc4-248dc65f9a1a admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.271342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae20f-af92-4569-9dc4-248dc65f9a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.271342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae20f-af92-4569-9dc4-248dc65f9a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.271824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ae20f-af92-4569-9dc4-248dc65f9a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:15.273497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ae20f-af92-4569-9dc4-248dc65f9a1a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:15.301004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1212/2420] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:15 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:15.305239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96076ac8-85c0-4b30-834a-5880408f2556 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:15.316945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96076ac8-85c0-4b30-834a-5880408f2556 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:15.398332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b57f1-06cf-4907-9f63-1bbd10128800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:15.399030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b57f1-06cf-4907-9f63-1bbd10128800 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.399332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b57f1-06cf-4907-9f63-1bbd10128800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.399632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b57f1-06cf-4907-9f63-1bbd10128800 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.400317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b57f1-06cf-4907-9f63-1bbd10128800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:15.402326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b57f1-06cf-4907-9f63-1bbd10128800 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:15.428847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1209/2421] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:15 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:15.430403 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ae20f-af92-4569-9dc4-248dc65f9a1a admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:15.442054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ae20f-af92-4569-9dc4-248dc65f9a1a admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:15.447442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282873d-9d16-4c58-8b9b-e92eca2fccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:15.448231 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282873d-9d16-4c58-8b9b-e92eca2fccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.448513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282873d-9d16-4c58-8b9b-e92eca2fccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.448784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282873d-9d16-4c58-8b9b-e92eca2fccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.449510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282873d-9d16-4c58-8b9b-e92eca2fccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:15.451349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282873d-9d16-4c58-8b9b-e92eca2fccb7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:15.463343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1213/2422] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:15.467247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b57f1-06cf-4907-9f63-1bbd10128800 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:15.478965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b57f1-06cf-4907-9f63-1bbd10128800 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:15.484977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807a458-587a-4bd5-8867-dd01810d7c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:15.486286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a458-587a-4bd5-8867-dd01810d7c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.486734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a458-587a-4bd5-8867-dd01810d7c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.487106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807a458-587a-4bd5-8867-dd01810d7c94 admin admin] PATH_INFO: `/v3/projects/e7297554a40d4b87b5fe79a87abd9eb4/users/6e0e69740f9d4423ae7417effbdf2c83/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.504652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807a458-587a-4bd5-8867-dd01810d7c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7297554a40d4b87b5fe79a87abd9eb4, user_id=6e0e69740f9d4423ae7417effbdf2c83, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:15.507452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807a458-587a-4bd5-8867-dd01810d7c94 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:15.529363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1210/2423] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:15 2022] PUT /identity/v3/projects/e7297554a40d4b87b5fe79a87abd9eb4/users/6e0e69740f9d4423ae7417effbdf2c83/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:15.531890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282873d-9d16-4c58-8b9b-e92eca2fccb7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:15.545350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282873d-9d16-4c58-8b9b-e92eca2fccb7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:15.629074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4b712-bc2f-4430-a0de-c999cb242edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:15.631342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b712-bc2f-4430-a0de-c999cb242edb admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.632934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b712-bc2f-4430-a0de-c999cb242edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.633618 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b712-bc2f-4430-a0de-c999cb242edb admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.634798 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4b712-bc2f-4430-a0de-c999cb242edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:15.636691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4b712-bc2f-4430-a0de-c999cb242edb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:15.659018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1214/2424] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:15.659461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807a458-587a-4bd5-8867-dd01810d7c94 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:15.677671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807a458-587a-4bd5-8867-dd01810d7c94 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:15.710695 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:15.712217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.712712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.713180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] PATH_INFO: `/v3/projects/e7297554a40d4b87b5fe79a87abd9eb4/users/6e0e69740f9d4423ae7417effbdf2c83/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.715464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7297554a40d4b87b5fe79a87abd9eb4, user_id=6e0e69740f9d4423ae7417effbdf2c83, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:15.726080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:15.759714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1211/2425] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:15 2022] PUT /identity/v3/projects/e7297554a40d4b87b5fe79a87abd9eb4/users/6e0e69740f9d4423ae7417effbdf2c83/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:15.770946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a25993-3619-44d9-a7ed-1a593788c87a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:15.771552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a25993-3619-44d9-a7ed-1a593788c87a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:15.771552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a25993-3619-44d9-a7ed-1a593788c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:15.820754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c9a25993-3619-44d9-a7ed-1a593788c87a None None] MFA Rules not processed for user `6e0e69740f9d4423ae7417effbdf2c83`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:15.822015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c9a25993-3619-44d9-a7ed-1a593788c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:15.980898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1215/2426] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:15.992415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:15.994149 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:16.065739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113737d-0588-4d1b-9e39-4fe05927ea2c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:16.073397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d296bbc-07e1-49ce-b2de-32295869d4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:16.073623 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296bbc-07e1-49ce-b2de-32295869d4bc service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:16.073904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296bbc-07e1-49ce-b2de-32295869d4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:16.074194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296bbc-07e1-49ce-b2de-32295869d4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:16.084748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d296bbc-07e1-49ce-b2de-32295869d4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:16.086322 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d296bbc-07e1-49ce-b2de-32295869d4bc service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:16.102601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1212/2427] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:16.771526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a25993-3619-44d9-a7ed-1a593788c87a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:16.838221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a25993-3619-44d9-a7ed-1a593788c87a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:16.843815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:16.844775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:16.845169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:16.845476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] PATH_INFO: `/v3/users/57ad7a76950b4a60a94a64bc6a77451f` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:16.846677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ad7a76950b4a60a94a64bc6a77451f)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:16.848818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:16.907454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ad7a76950b4a60a94a64bc6a77451f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:16.915502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ad7a76950b4a60a94a64bc6a77451f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:16.925005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ad7a76950b4a60a94a64bc6a77451f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:16.925832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ad7a76950b4a60a94a64bc6a77451f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:16.940951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ad7a76950b4a60a94a64bc6a77451f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:16.947966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1216/2428] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:16 2022] DELETE /identity/v3/users/57ad7a76950b4a60a94a64bc6a77451f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:16.952600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545586-3ae1-4e13-af03-091d25f8c364 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:16.953138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545586-3ae1-4e13-af03-091d25f8c364 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:16.953138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545586-3ae1-4e13-af03-091d25f8c364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:16.973304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-3f545586-3ae1-4e13-af03-091d25f8c364 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:16.974566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3f545586-3ae1-4e13-af03-091d25f8c364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:17.048936 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1213/2429] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:17.055589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:17.057050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:17.124736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f161e12-5568-4d15-a436-788636ee4d77 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:17.129154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403d281-09c5-4a18-a07b-66e3fcf2a045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:17.130032 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d281-09c5-4a18-a07b-66e3fcf2a045 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:17.130374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d281-09c5-4a18-a07b-66e3fcf2a045 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:17.130712 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d281-09c5-4a18-a07b-66e3fcf2a045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:17.141861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403d281-09c5-4a18-a07b-66e3fcf2a045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:17.143367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403d281-09c5-4a18-a07b-66e3fcf2a045 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:17.154367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1217/2430] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:17.543741 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545586-3ae1-4e13-af03-091d25f8c364 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:17.545247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3f545586-3ae1-4e13-af03-091d25f8c364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:17.558008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545586-3ae1-4e13-af03-091d25f8c364 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:17.563336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:17.564151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:17.564649 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:17.565023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] PATH_INFO: `/v3/projects/eca810b8505443c797dd3dc2d8dc7bf9` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:17.566395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca810b8505443c797dd3dc2d8dc7bf9)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:17.569175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:17.639457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca810b8505443c797dd3dc2d8dc7bf9', 'request_id': 'req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.645821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca810b8505443c797dd3dc2d8dc7bf9', 'request_id': 'req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.654626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca810b8505443c797dd3dc2d8dc7bf9', 'request_id': 'req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.670784 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] The token cache is being invalidate because project eca810b8505443c797dd3dc2d8dc7bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:17.671057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.671968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.676689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1214/2431] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:17 2022] DELETE /identity/v3/projects/eca810b8505443c797dd3dc2d8dc7bf9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:17.677619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403d281-09c5-4a18-a07b-66e3fcf2a045 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:17.690499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403d281-09c5-4a18-a07b-66e3fcf2a045 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:17.761981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:17.762859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:17.763141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:17.763456 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] PATH_INFO: `/v3/users/6e0e69740f9d4423ae7417effbdf2c83` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:17.764649 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0e69740f9d4423ae7417effbdf2c83)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:17.767148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:17.819414 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0e69740f9d4423ae7417effbdf2c83'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.831917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0e69740f9d4423ae7417effbdf2c83'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.841471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0e69740f9d4423ae7417effbdf2c83'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.842419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0e69740f9d4423ae7417effbdf2c83'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.860256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0c97b249-9b2b-4f73-9f4e-98283eed879a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0e69740f9d4423ae7417effbdf2c83'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:17.871487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1218/2432] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:17 2022] DELETE /identity/v3/users/6e0e69740f9d4423ae7417effbdf2c83 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:18.191979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:18.193507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:18.212590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b8f2b-1f9e-4cfc-a9fb-1db892fa1a48 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:18.348847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:18.349721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.349999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.350269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] PATH_INFO: `/v3/projects/e7297554a40d4b87b5fe79a87abd9eb4` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.352092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7297554a40d4b87b5fe79a87abd9eb4)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:18.353362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:18.422777 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7297554a40d4b87b5fe79a87abd9eb4', 'request_id': 'req-50b04992-9dcf-4706-8e67-6898d8de26b6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:18.428843 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7297554a40d4b87b5fe79a87abd9eb4', 'request_id': 'req-50b04992-9dcf-4706-8e67-6898d8de26b6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:18.437332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7297554a40d4b87b5fe79a87abd9eb4', 'request_id': 'req-50b04992-9dcf-4706-8e67-6898d8de26b6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:18.457340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] The token cache is being invalidate because project e7297554a40d4b87b5fe79a87abd9eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:18.457908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:18.458611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-50b04992-9dcf-4706-8e67-6898d8de26b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:18.460735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1215/2433] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:18 2022] DELETE /identity/v3/projects/e7297554a40d4b87b5fe79a87abd9eb4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:18.465599 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42be2-3b79-4709-8f36-fbd0cf52531a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.466217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42be2-3b79-4709-8f36-fbd0cf52531a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.466659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42be2-3b79-4709-8f36-fbd0cf52531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.486397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-78a42be2-3b79-4709-8f36-fbd0cf52531a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:18.488550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-78a42be2-3b79-4709-8f36-fbd0cf52531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:18.567279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1219/2434] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:18.576353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3f2b-c7de-4fa2-80f7-b4231eec66a1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.576664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3f2b-c7de-4fa2-80f7-b4231eec66a1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.577013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3f2b-c7de-4fa2-80f7-b4231eec66a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.597546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a19e3f2b-c7de-4fa2-80f7-b4231eec66a1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:18.600858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a19e3f2b-c7de-4fa2-80f7-b4231eec66a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:18.607421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1216/2435] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:18.612176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42be2-3b79-4709-8f36-fbd0cf52531a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:18.622176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42be2-3b79-4709-8f36-fbd0cf52531a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:18.627616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:18.628408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.628791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.629167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.630003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:04:18.630409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:18.632521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:18.648998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1220/2436] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:04:18.649837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e3f2b-c7de-4fa2-80f7-b4231eec66a1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:18.659624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e3f2b-c7de-4fa2-80f7-b4231eec66a1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:18.667971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace111-44ed-408d-bdc7-9c5f8e628bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:18.669161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace111-44ed-408d-bdc7-9c5f8e628bbf admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.669674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace111-44ed-408d-bdc7-9c5f8e628bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.670330 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace111-44ed-408d-bdc7-9c5f8e628bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.672001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eace111-44ed-408d-bdc7-9c5f8e628bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:18.674032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eace111-44ed-408d-bdc7-9c5f8e628bbf admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:18.709970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1217/2437] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:18 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:18.714202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:18.726942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567002aa-bc75-44f6-a3d8-af53a20b8db7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:18.814340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519eaac-f644-45ea-92ca-2dfbc11090a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:18.815135 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519eaac-f644-45ea-92ca-2dfbc11090a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.815504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519eaac-f644-45ea-92ca-2dfbc11090a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.815849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519eaac-f644-45ea-92ca-2dfbc11090a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.816613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519eaac-f644-45ea-92ca-2dfbc11090a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:18.819027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519eaac-f644-45ea-92ca-2dfbc11090a6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:18.843681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1221/2438] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:18 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:18.847780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace111-44ed-408d-bdc7-9c5f8e628bbf admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:18.860613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace111-44ed-408d-bdc7-9c5f8e628bbf admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:18.865668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea37b13-fe8c-4c48-8bb3-b4b493e58c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:18.866601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea37b13-fe8c-4c48-8bb3-b4b493e58c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.866958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea37b13-fe8c-4c48-8bb3-b4b493e58c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.867334 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea37b13-fe8c-4c48-8bb3-b4b493e58c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.868129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea37b13-fe8c-4c48-8bb3-b4b493e58c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:18.869842 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea37b13-fe8c-4c48-8bb3-b4b493e58c1f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:18.884897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1218/2439] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:04:18.888605 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519eaac-f644-45ea-92ca-2dfbc11090a6 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:18.901533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519eaac-f644-45ea-92ca-2dfbc11090a6 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:18.906343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e582dfd-5835-40e8-94cd-2fc0a2d8c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:18.907069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582dfd-5835-40e8-94cd-2fc0a2d8c1eb admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.907289 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582dfd-5835-40e8-94cd-2fc0a2d8c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.907587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582dfd-5835-40e8-94cd-2fc0a2d8c1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.908306 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e582dfd-5835-40e8-94cd-2fc0a2d8c1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:18.909897 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e582dfd-5835-40e8-94cd-2fc0a2d8c1eb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:18.925883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1222/2440] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:18.927374 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea37b13-fe8c-4c48-8bb3-b4b493e58c1f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:18.938430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea37b13-fe8c-4c48-8bb3-b4b493e58c1f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:18.943384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75748d5-5d36-4cba-8608-02460827af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:18.944532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75748d5-5d36-4cba-8608-02460827af22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.944813 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75748d5-5d36-4cba-8608-02460827af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.945086 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75748d5-5d36-4cba-8608-02460827af22 admin admin] PATH_INFO: `/v3/projects/56d1beeba0ab44b68fbd606038efe351/users/a68ff1393dfb4b2eb9f5b87a65d9f98c/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:18.962511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75748d5-5d36-4cba-8608-02460827af22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d1beeba0ab44b68fbd606038efe351, user_id=a68ff1393dfb4b2eb9f5b87a65d9f98c, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:18.965666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75748d5-5d36-4cba-8608-02460827af22 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:18.981896 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1219/2441] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:18 2022] PUT /identity/v3/projects/56d1beeba0ab44b68fbd606038efe351/users/a68ff1393dfb4b2eb9f5b87a65d9f98c/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:18.992514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb3ba2-6616-46a7-ba7e-b25c593e26dd None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:18.993131 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb3ba2-6616-46a7-ba7e-b25c593e26dd None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:18.993577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb3ba2-6616-46a7-ba7e-b25c593e26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.027222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-becb3ba2-6616-46a7-ba7e-b25c593e26dd None None] MFA Rules not processed for user `a68ff1393dfb4b2eb9f5b87a65d9f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:19.028495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-becb3ba2-6616-46a7-ba7e-b25c593e26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:19.109386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1223/2442] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:19.113557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75748d5-5d36-4cba-8608-02460827af22 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:19.186961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75748d5-5d36-4cba-8608-02460827af22 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:19.192176 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0445-3b1f-4ebe-8122-624a8636b2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:19.192937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0445-3b1f-4ebe-8122-624a8636b2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:19.193436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0445-3b1f-4ebe-8122-624a8636b2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:19.194045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0445-3b1f-4ebe-8122-624a8636b2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.194815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0445-3b1f-4ebe-8122-624a8636b2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:19.196956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0445-3b1f-4ebe-8122-624a8636b2c1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:19.232059 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1220/2443] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:19 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:19.237295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb3ba2-6616-46a7-ba7e-b25c593e26dd None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:19.249233 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb3ba2-6616-46a7-ba7e-b25c593e26dd None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:19.314028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae1a9-3ece-4cc9-a48e-6261c0bf8a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:19.314901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae1a9-3ece-4cc9-a48e-6261c0bf8a96 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:19.315284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae1a9-3ece-4cc9-a48e-6261c0bf8a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:19.315687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae1a9-3ece-4cc9-a48e-6261c0bf8a96 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.316496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ae1a9-3ece-4cc9-a48e-6261c0bf8a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:19.318526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ae1a9-3ece-4cc9-a48e-6261c0bf8a96 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:19.343831 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1224/2444] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:19 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:19.347755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0445-3b1f-4ebe-8122-624a8636b2c1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:19.359209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0445-3b1f-4ebe-8122-624a8636b2c1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:19.363816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaf9f0-dac7-4d4b-b998-d4d983e1a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:19.364470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaf9f0-dac7-4d4b-b998-d4d983e1a98a admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:19.364746 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaf9f0-dac7-4d4b-b998-d4d983e1a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:19.365015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaf9f0-dac7-4d4b-b998-d4d983e1a98a admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.365733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaf9f0-dac7-4d4b-b998-d4d983e1a98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:19.367968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaf9f0-dac7-4d4b-b998-d4d983e1a98a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:19.380529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1221/2445] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:19.384266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae1a9-3ece-4cc9-a48e-6261c0bf8a96 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:19.395134 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae1a9-3ece-4cc9-a48e-6261c0bf8a96 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:19.400120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bffec-1b33-463c-9e4b-45f8c9fe7dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:19.401091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bffec-1b33-463c-9e4b-45f8c9fe7dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:19.401365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bffec-1b33-463c-9e4b-45f8c9fe7dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:19.401633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bffec-1b33-463c-9e4b-45f8c9fe7dcb admin admin] PATH_INFO: `/v3/projects/c4da65f945e649f0bb210617bd990eb4/users/ac94cba98cbf4c4ba17eceb71f853eee/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.419188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bffec-1b33-463c-9e4b-45f8c9fe7dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4da65f945e649f0bb210617bd990eb4, user_id=ac94cba98cbf4c4ba17eceb71f853eee, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:19.422146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bffec-1b33-463c-9e4b-45f8c9fe7dcb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:19.441355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1225/2446] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:19 2022] PUT /identity/v3/projects/c4da65f945e649f0bb210617bd990eb4/users/ac94cba98cbf4c4ba17eceb71f853eee/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:04:19.445296 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaf9f0-dac7-4d4b-b998-d4d983e1a98a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:19.456571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaf9f0-dac7-4d4b-b998-d4d983e1a98a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:19.520240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3d677-c631-4720-ac43-7ad12df487e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:19.521067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d677-c631-4720-ac43-7ad12df487e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:19.521471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d677-c631-4720-ac43-7ad12df487e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:19.521849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d677-c631-4720-ac43-7ad12df487e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.522819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d677-c631-4720-ac43-7ad12df487e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:19.524832 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d677-c631-4720-ac43-7ad12df487e9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:19.535701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1222/2447] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:19.539864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bffec-1b33-463c-9e4b-45f8c9fe7dcb admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:19.551836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bffec-1b33-463c-9e4b-45f8c9fe7dcb admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:19.556830 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:19.557785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:19.558299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:19.558643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] PATH_INFO: `/v3/projects/c4da65f945e649f0bb210617bd990eb4/users/ac94cba98cbf4c4ba17eceb71f853eee/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.560722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4da65f945e649f0bb210617bd990eb4, user_id=ac94cba98cbf4c4ba17eceb71f853eee, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:19.564301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:19.583783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1226/2448] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:19 2022] PUT /identity/v3/projects/c4da65f945e649f0bb210617bd990eb4/users/ac94cba98cbf4c4ba17eceb71f853eee/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:04:19.594395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97661b6-5d39-4181-ae86-d407f8a362a3 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:19.594680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97661b6-5d39-4181-ae86-d407f8a362a3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:19.594958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97661b6-5d39-4181-ae86-d407f8a362a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.622991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a97661b6-5d39-4181-ae86-d407f8a362a3 None None] MFA Rules not processed for user `ac94cba98cbf4c4ba17eceb71f853eee`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:19.627594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a97661b6-5d39-4181-ae86-d407f8a362a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:19.703809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1223/2449] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:19.715333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:19.717195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:19.799410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810aa7-8cb0-444f-b21d-8f40b347c56b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:19.803083 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359235a-e178-482e-95e7-ec8a796f69e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:19.803774 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359235a-e178-482e-95e7-ec8a796f69e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:19.804054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359235a-e178-482e-95e7-ec8a796f69e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:19.804328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359235a-e178-482e-95e7-ec8a796f69e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:19.869158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359235a-e178-482e-95e7-ec8a796f69e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:19.870759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359235a-e178-482e-95e7-ec8a796f69e6 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:19.885506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1227/2450] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:24.172586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97661b6-5d39-4181-ae86-d407f8a362a3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:24.173977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a97661b6-5d39-4181-ae86-d407f8a362a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:24.185511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97661b6-5d39-4181-ae86-d407f8a362a3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:24.189575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddac04f-c3f3-4459-b065-dda86057fe43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:24.190206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddac04f-c3f3-4459-b065-dda86057fe43 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:24.190480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddac04f-c3f3-4459-b065-dda86057fe43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:24.190748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddac04f-c3f3-4459-b065-dda86057fe43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:24.199750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddac04f-c3f3-4459-b065-dda86057fe43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:24.201228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddac04f-c3f3-4459-b065-dda86057fe43 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:24.211118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1224/2451] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:29.028881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359235a-e178-482e-95e7-ec8a796f69e6 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:29.090684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359235a-e178-482e-95e7-ec8a796f69e6 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:29.095389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:29.096215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:29.096496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:29.096760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] PATH_INFO: `/v3/users/a68ff1393dfb4b2eb9f5b87a65d9f98c` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:29.097949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68ff1393dfb4b2eb9f5b87a65d9f98c)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:29.099927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:29.148103 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68ff1393dfb4b2eb9f5b87a65d9f98c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.159039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68ff1393dfb4b2eb9f5b87a65d9f98c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.166835 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68ff1393dfb4b2eb9f5b87a65d9f98c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.167883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68ff1393dfb4b2eb9f5b87a65d9f98c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.182462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68ff1393dfb4b2eb9f5b87a65d9f98c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.189486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1228/2452] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:29 2022] DELETE /identity/v3/users/a68ff1393dfb4b2eb9f5b87a65d9f98c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:29.194258 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321fd58-dfd9-4c36-81d1-1079f02d1433 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:29.194723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321fd58-dfd9-4c36-81d1-1079f02d1433 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:29.194941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321fd58-dfd9-4c36-81d1-1079f02d1433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:29.216185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-6321fd58-dfd9-4c36-81d1-1079f02d1433 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:29.217578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6321fd58-dfd9-4c36-81d1-1079f02d1433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:29.278903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1225/2453] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:29.288624 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:29.290132 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:29.349662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4632a-1d2d-4567-bf41-e523c1fe2998 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:29.353186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cde8-8e36-4985-8e1c-52c61530f745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:29.353826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cde8-8e36-4985-8e1c-52c61530f745 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:29.354106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cde8-8e36-4985-8e1c-52c61530f745 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:29.354379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cde8-8e36-4985-8e1c-52c61530f745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:29.364022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202cde8-8e36-4985-8e1c-52c61530f745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:29.365455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202cde8-8e36-4985-8e1c-52c61530f745 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:29.376098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1229/2454] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:29.642738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321fd58-dfd9-4c36-81d1-1079f02d1433 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:29.644214 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6321fd58-dfd9-4c36-81d1-1079f02d1433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:29.662262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321fd58-dfd9-4c36-81d1-1079f02d1433 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:29.667088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:29.667975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:29.668257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:29.668528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] PATH_INFO: `/v3/projects/56d1beeba0ab44b68fbd606038efe351` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:29.669704 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d1beeba0ab44b68fbd606038efe351)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:29.672289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:29.720356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d1beeba0ab44b68fbd606038efe351', 'request_id': 'req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.725921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d1beeba0ab44b68fbd606038efe351', 'request_id': 'req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.734537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d1beeba0ab44b68fbd606038efe351', 'request_id': 'req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.745890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] The token cache is being invalidate because project 56d1beeba0ab44b68fbd606038efe351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:29.746176 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.746821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.748375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1226/2455] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:29 2022] DELETE /identity/v3/projects/56d1beeba0ab44b68fbd606038efe351 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:29.752323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cde8-8e36-4985-8e1c-52c61530f745 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:29.762682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cde8-8e36-4985-8e1c-52c61530f745 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:29.818400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:29.819543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:29.819823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:29.820093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] PATH_INFO: `/v3/users/ac94cba98cbf4c4ba17eceb71f853eee` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:29.821283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac94cba98cbf4c4ba17eceb71f853eee)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:29.823217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:29.876703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac94cba98cbf4c4ba17eceb71f853eee'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.884410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac94cba98cbf4c4ba17eceb71f853eee'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.892478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac94cba98cbf4c4ba17eceb71f853eee'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.893138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac94cba98cbf4c4ba17eceb71f853eee'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.906508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f14fc86-3f9c-4aa1-837a-8c81fc3d7dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac94cba98cbf4c4ba17eceb71f853eee'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:29.912496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1230/2456] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:29 2022] DELETE /identity/v3/users/ac94cba98cbf4c4ba17eceb71f853eee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:04:30.172022 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:30.173498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:30.186895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a079b72-8ccc-4f7d-88f2-f3efebc0dbbe admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:30.257590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:30.258460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.258738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.259008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] PATH_INFO: `/v3/projects/c4da65f945e649f0bb210617bd990eb4` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.260211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4da65f945e649f0bb210617bd990eb4)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:30.262111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:30.306833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4da65f945e649f0bb210617bd990eb4', 'request_id': 'req-8b7700e6-23ec-440d-a5fc-af42ac740277'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:30.312976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4da65f945e649f0bb210617bd990eb4', 'request_id': 'req-8b7700e6-23ec-440d-a5fc-af42ac740277'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:30.321658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4da65f945e649f0bb210617bd990eb4', 'request_id': 'req-8b7700e6-23ec-440d-a5fc-af42ac740277'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:30.335327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] The token cache is being invalidate because project c4da65f945e649f0bb210617bd990eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:30.335692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:30.336247 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7700e6-23ec-440d-a5fc-af42ac740277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:30.338138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1227/2457] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:30 2022] DELETE /identity/v3/projects/c4da65f945e649f0bb210617bd990eb4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:30.343784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f25c4-83f4-4d47-8c8f-a3ea865c281e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.344595 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f25c4-83f4-4d47-8c8f-a3ea865c281e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.344879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f25c4-83f4-4d47-8c8f-a3ea865c281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.363115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-904f25c4-83f4-4d47-8c8f-a3ea865c281e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:30.364512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-904f25c4-83f4-4d47-8c8f-a3ea865c281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:30.425455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1231/2458] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:04:30.489662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980ba0-cb3f-433a-b46c-99099b89d051 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.489946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980ba0-cb3f-433a-b46c-99099b89d051 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.490225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980ba0-cb3f-433a-b46c-99099b89d051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.509283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b8980ba0-cb3f-433a-b46c-99099b89d051 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:30.510476 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b8980ba0-cb3f-433a-b46c-99099b89d051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:30.519182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1228/2459] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:30.523435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f25c4-83f4-4d47-8c8f-a3ea865c281e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:30.532839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f25c4-83f4-4d47-8c8f-a3ea865c281e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:30.537717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:30.538377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.538658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.538944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.539682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:04:30.539997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:30.541603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:30.560273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1232/2460] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:04:30.560473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8980ba0-cb3f-433a-b46c-99099b89d051 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:30.569555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8980ba0-cb3f-433a-b46c-99099b89d051 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:30.574683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5c6d-4208-451e-8925-123f34aebede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:30.575368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5c6d-4208-451e-8925-123f34aebede admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.575650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5c6d-4208-451e-8925-123f34aebede admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.575924 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd5c6d-4208-451e-8925-123f34aebede admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.576614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd5c6d-4208-451e-8925-123f34aebede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:30.579090 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd5c6d-4208-451e-8925-123f34aebede admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:30.604137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1229/2461] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:30 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:30.608652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:30.618615 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6cf1e-367d-4406-8169-7b4bfc327e5f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:30.674061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0038d-31fb-4c22-966a-fceb861cb3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:30.674787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0038d-31fb-4c22-966a-fceb861cb3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.675071 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0038d-31fb-4c22-966a-fceb861cb3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.675389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0038d-31fb-4c22-966a-fceb861cb3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.676153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0038d-31fb-4c22-966a-fceb861cb3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:30.678024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0038d-31fb-4c22-966a-fceb861cb3f8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:30.699037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1233/2462] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:30 2022] POST /identity/v3/users => generated 280 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:30.703064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5c6d-4208-451e-8925-123f34aebede admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:30.713952 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd5c6d-4208-451e-8925-123f34aebede admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:30.718484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11fed-64e9-4945-9492-3c38944891f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:30.719144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11fed-64e9-4945-9492-3c38944891f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.719461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11fed-64e9-4945-9492-3c38944891f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.719737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11fed-64e9-4945-9492-3c38944891f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.720882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af11fed-64e9-4945-9492-3c38944891f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:30.722065 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af11fed-64e9-4945-9492-3c38944891f7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:30.732644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1230/2463] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:30.737139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0038d-31fb-4c22-966a-fceb861cb3f8 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:30.747199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0038d-31fb-4c22-966a-fceb861cb3f8 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:30.752422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd79c9-9c2a-4a65-bf3e-d222f72e0063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:30.753078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd79c9-9c2a-4a65-bf3e-d222f72e0063 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.753378 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd79c9-9c2a-4a65-bf3e-d222f72e0063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.753648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd79c9-9c2a-4a65-bf3e-d222f72e0063 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.754365 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd79c9-9c2a-4a65-bf3e-d222f72e0063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:30.756036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd79c9-9c2a-4a65-bf3e-d222f72e0063 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:30.766110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1234/2464] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:30.770529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11fed-64e9-4945-9492-3c38944891f7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:30.780401 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11fed-64e9-4945-9492-3c38944891f7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:30.785032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:30.785902 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.786183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.786451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] PATH_INFO: `/v3/projects/c8b8711e1ed54dc689a8ed885a1f21cf/users/cbd7d58694ea46f78bee61a9d6ac4f45/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.801570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b8711e1ed54dc689a8ed885a1f21cf, user_id=cbd7d58694ea46f78bee61a9d6ac4f45, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:30.804251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:30.817711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1231/2465] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:30 2022] PUT /identity/v3/projects/c8b8711e1ed54dc689a8ed885a1f21cf/users/cbd7d58694ea46f78bee61a9d6ac4f45/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:30.828980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cad62-8ddb-4b2f-9905-8f1a04dbe67f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:30.829267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cad62-8ddb-4b2f-9905-8f1a04dbe67f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:30.829549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cad62-8ddb-4b2f-9905-8f1a04dbe67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:30.854960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0f1cad62-8ddb-4b2f-9905-8f1a04dbe67f None None] MFA Rules not processed for user `cbd7d58694ea46f78bee61a9d6ac4f45`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:30.856276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0f1cad62-8ddb-4b2f-9905-8f1a04dbe67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:30.919479 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1235/2466] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:04:30.951836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:30.953542 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:31.008402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc966ce-e07c-444e-b11f-e7c4091cbc69 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:31.012061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec1078-f18f-4ee4-b72f-b3e60e136a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:31.012702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec1078-f18f-4ee4-b72f-b3e60e136a50 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:31.012961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec1078-f18f-4ee4-b72f-b3e60e136a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:31.013236 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec1078-f18f-4ee4-b72f-b3e60e136a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:31.021531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec1078-f18f-4ee4-b72f-b3e60e136a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:31.022958 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec1078-f18f-4ee4-b72f-b3e60e136a50 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:31.032117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1232/2467] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:30 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:31.047339 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cad62-8ddb-4b2f-9905-8f1a04dbe67f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:31.111606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cad62-8ddb-4b2f-9905-8f1a04dbe67f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:31.116256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:31.117135 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:31.117415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:31.117689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] PATH_INFO: `/v3/users/cbd7d58694ea46f78bee61a9d6ac4f45` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:31.118893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd7d58694ea46f78bee61a9d6ac4f45)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:31.120842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:31.166308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5bdea-db51-4db7-8688-d6f9472a7603 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:31.166619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5bdea-db51-4db7-8688-d6f9472a7603 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:31.166895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5bdea-db51-4db7-8688-d6f9472a7603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:31.167280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd7d58694ea46f78bee61a9d6ac4f45'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.175092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd7d58694ea46f78bee61a9d6ac4f45'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.182873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd7d58694ea46f78bee61a9d6ac4f45'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.183484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd7d58694ea46f78bee61a9d6ac4f45'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.184703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-15c5bdea-db51-4db7-8688-d6f9472a7603 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:31.185915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-15c5bdea-db51-4db7-8688-d6f9472a7603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:31.195215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b79c8d2c-dac9-4a29-8fd3-c11fb535f8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd7d58694ea46f78bee61a9d6ac4f45'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.201276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1236/2468] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:04:31 2022] DELETE /identity/v3/users/cbd7d58694ea46f78bee61a9d6ac4f45 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:31.205658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddec24-f991-4d5f-ae2d-bcefcdcbaaf7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:31.205944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddec24-f991-4d5f-ae2d-bcefcdcbaaf7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:31.206217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddec24-f991-4d5f-ae2d-bcefcdcbaaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:31.225885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-59ddec24-f991-4d5f-ae2d-bcefcdcbaaf7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:31.227086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-59ddec24-f991-4d5f-ae2d-bcefcdcbaaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:31.247767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1233/2469] 10.222.0.93 () {58 vars in 1009 bytes} [Wed May 11 19:04:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:31.259807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5bdea-db51-4db7-8688-d6f9472a7603 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:31.261151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-15c5bdea-db51-4db7-8688-d6f9472a7603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:31.286111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1237/2470] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:04:31.296355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddec24-f991-4d5f-ae2d-bcefcdcbaaf7 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:31.297695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-59ddec24-f991-4d5f-ae2d-bcefcdcbaaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:31.329340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5bdea-db51-4db7-8688-d6f9472a7603 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:31.351986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddec24-f991-4d5f-ae2d-bcefcdcbaaf7 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:31.355552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:31.356186 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:31.356462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:31.356730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:31.367320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:31.368775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:31.378061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1238/2471] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:04:31.386703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958371-6bd4-4356-a674-861422774556 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:31.387380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958371-6bd4-4356-a674-861422774556 service swift] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:31.387665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958371-6bd4-4356-a674-861422774556 service swift] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:31.387940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958371-6bd4-4356-a674-861422774556 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:31.444159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b958371-6bd4-4356-a674-861422774556 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:31.445831 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b958371-6bd4-4356-a674-861422774556 service swift] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:31.454887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1234/2472] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 19:04:31.752609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:31.754251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:31.775758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafafb3-55d5-42ec-a2bc-c3c3a6d7c139 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:31.794702 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:31.795746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:31.796246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:31.796524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] PATH_INFO: `/v3/projects/c8b8711e1ed54dc689a8ed885a1f21cf` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:31.797743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b8711e1ed54dc689a8ed885a1f21cf)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:31.799754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:31.897000 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b8711e1ed54dc689a8ed885a1f21cf', 'request_id': 'req-0f07e49a-f427-4a33-8902-7a8f70ccb38c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.901685 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b8711e1ed54dc689a8ed885a1f21cf', 'request_id': 'req-0f07e49a-f427-4a33-8902-7a8f70ccb38c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.912369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b8711e1ed54dc689a8ed885a1f21cf', 'request_id': 'req-0f07e49a-f427-4a33-8902-7a8f70ccb38c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.929417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] The token cache is being invalidate because project c8b8711e1ed54dc689a8ed885a1f21cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:04:31.929970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.930740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0f07e49a-f427-4a33-8902-7a8f70ccb38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:04:31.932698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1239/2473] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:04:31 2022] DELETE /identity/v3/projects/c8b8711e1ed54dc689a8ed885a1f21cf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:31.938729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a4213-807f-4730-87fe-b0f35b20adce None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:31.939024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a4213-807f-4730-87fe-b0f35b20adce None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:31.939280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a4213-807f-4730-87fe-b0f35b20adce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:31.958834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-741a4213-807f-4730-87fe-b0f35b20adce None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:31.960380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-741a4213-807f-4730-87fe-b0f35b20adce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:32.029609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1235/2474] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:32.037528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0924a47-63e3-496f-8688-37ba40c49956 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.038211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0924a47-63e3-496f-8688-37ba40c49956 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.038587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0924a47-63e3-496f-8688-37ba40c49956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.060360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c0924a47-63e3-496f-8688-37ba40c49956 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:32.062743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c0924a47-63e3-496f-8688-37ba40c49956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:32.071581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1240/2475] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:04:32.075864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a4213-807f-4730-87fe-b0f35b20adce None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:32.086414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a4213-807f-4730-87fe-b0f35b20adce None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:32.091481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:32.092142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.092461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.092730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.093461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:04:32.093769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:32.095461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:32.109521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1236/2476] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:04:32.114024 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0924a47-63e3-496f-8688-37ba40c49956 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:32.129111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0924a47-63e3-496f-8688-37ba40c49956 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:32.135671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08063-b051-47d3-95e2-9335155465a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:32.136349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08063-b051-47d3-95e2-9335155465a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.136627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08063-b051-47d3-95e2-9335155465a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.136903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08063-b051-47d3-95e2-9335155465a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.137705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd08063-b051-47d3-95e2-9335155465a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:32.140318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd08063-b051-47d3-95e2-9335155465a9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:32.173143 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1241/2477] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:32 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:32.177378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:32.188134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee091108-c674-4059-8323-266f14c502c9 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:32.243672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58ac9-72b1-426b-b548-4baa0ffb0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:32.244342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58ac9-72b1-426b-b548-4baa0ffb0812 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.244621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58ac9-72b1-426b-b548-4baa0ffb0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.244895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58ac9-72b1-426b-b548-4baa0ffb0812 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.245581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58ac9-72b1-426b-b548-4baa0ffb0812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:32.247503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58ac9-72b1-426b-b548-4baa0ffb0812 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:32.267037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1237/2478] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:32 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:32.271149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08063-b051-47d3-95e2-9335155465a9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:32.281585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08063-b051-47d3-95e2-9335155465a9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:32.286215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7542c75-d2af-473e-a636-aa62aed75bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:32.286871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7542c75-d2af-473e-a636-aa62aed75bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.287154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7542c75-d2af-473e-a636-aa62aed75bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.287469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7542c75-d2af-473e-a636-aa62aed75bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.288197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7542c75-d2af-473e-a636-aa62aed75bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:32.289795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7542c75-d2af-473e-a636-aa62aed75bc9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:32.300521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1242/2479] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:32.304392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58ac9-72b1-426b-b548-4baa0ffb0812 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:32.314602 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58ac9-72b1-426b-b548-4baa0ffb0812 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:32.319435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954c12-340a-43d9-8e5f-6c83a89da716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:32.320073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954c12-340a-43d9-8e5f-6c83a89da716 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.320349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954c12-340a-43d9-8e5f-6c83a89da716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.320619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954c12-340a-43d9-8e5f-6c83a89da716 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.321331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954c12-340a-43d9-8e5f-6c83a89da716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:32.322892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954c12-340a-43d9-8e5f-6c83a89da716 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:32.332445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1238/2480] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:32.336304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7542c75-d2af-473e-a636-aa62aed75bc9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:32.346044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7542c75-d2af-473e-a636-aa62aed75bc9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:32.350653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:32.351574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.351853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.352125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] PATH_INFO: `/v3/projects/aaad8f4e0e0b41c4b227a090b8260f61/users/ead71051e3c548e7989007c8f5d0abc0/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.367642 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaad8f4e0e0b41c4b227a090b8260f61, user_id=ead71051e3c548e7989007c8f5d0abc0, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:32.370317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:32.384015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1243/2481] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:32 2022] PUT /identity/v3/projects/aaad8f4e0e0b41c4b227a090b8260f61/users/ead71051e3c548e7989007c8f5d0abc0/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:04:32.389550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350068a7-b4e5-48a6-a8e3-5188604c6dd2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.389981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350068a7-b4e5-48a6-a8e3-5188604c6dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.390241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350068a7-b4e5-48a6-a8e3-5188604c6dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.412118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-350068a7-b4e5-48a6-a8e3-5188604c6dd2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:32.413408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-350068a7-b4e5-48a6-a8e3-5188604c6dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:32.490189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1239/2482] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:04:32.500379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:32.502120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:32.564331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97870d-bfd8-4c75-b73b-a1b81c7066c3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:32.568307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b896c5-81e0-4144-b56c-7cc99f795788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:32.569318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b896c5-81e0-4144-b56c-7cc99f795788 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:32.569665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b896c5-81e0-4144-b56c-7cc99f795788 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:32.570054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b896c5-81e0-4144-b56c-7cc99f795788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:32.579655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b896c5-81e0-4144-b56c-7cc99f795788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:32.581190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b896c5-81e0-4144-b56c-7cc99f795788 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:32.590791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1244/2483] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:37.666944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe607676-f553-494e-b35d-ab71b67b2eee None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:37.668127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe607676-f553-494e-b35d-ab71b67b2eee None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:37.668663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe607676-f553-494e-b35d-ab71b67b2eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:37.698383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-fe607676-f553-494e-b35d-ab71b67b2eee None None] MFA Rules not processed for user `ead71051e3c548e7989007c8f5d0abc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:37.699965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-fe607676-f553-494e-b35d-ab71b67b2eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:37.768886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1240/2484] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:37.773526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b896c5-81e0-4144-b56c-7cc99f795788 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:37.783477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b896c5-81e0-4144-b56c-7cc99f795788 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:37.788138 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c6792-f6d2-4965-96b9-d2be24cca573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:37.788828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c6792-f6d2-4965-96b9-d2be24cca573 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:37.789307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c6792-f6d2-4965-96b9-d2be24cca573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:37.789580 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c6792-f6d2-4965-96b9-d2be24cca573 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:37.790319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c6792-f6d2-4965-96b9-d2be24cca573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:37.792266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c6792-f6d2-4965-96b9-d2be24cca573 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:37.818792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1245/2485] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:04:37 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:04:37.822762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe607676-f553-494e-b35d-ab71b67b2eee None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:37.834373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe607676-f553-494e-b35d-ab71b67b2eee None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:37.900005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7d8d-c4b0-44d2-a318-95dbcc035e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:37.900962 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7d8d-c4b0-44d2-a318-95dbcc035e1b admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:37.901256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7d8d-c4b0-44d2-a318-95dbcc035e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:37.901530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7d8d-c4b0-44d2-a318-95dbcc035e1b admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:37.902237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d7d8d-c4b0-44d2-a318-95dbcc035e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:37.904531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d7d8d-c4b0-44d2-a318-95dbcc035e1b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:37.924717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1241/2486] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:04:37 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:04:37.928736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c6792-f6d2-4965-96b9-d2be24cca573 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:37.944556 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c6792-f6d2-4965-96b9-d2be24cca573 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:37.952933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa3e8-152c-4fff-856a-2da83662fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:37.953640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa3e8-152c-4fff-856a-2da83662fe76 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:37.953921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa3e8-152c-4fff-856a-2da83662fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:37.954189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa3e8-152c-4fff-856a-2da83662fe76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:37.954919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefa3e8-152c-4fff-856a-2da83662fe76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:37.956552 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefa3e8-152c-4fff-856a-2da83662fe76 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:37.973925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1246/2487] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:37.977030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7d8d-c4b0-44d2-a318-95dbcc035e1b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:37.987577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7d8d-c4b0-44d2-a318-95dbcc035e1b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:37.992481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7bee-ec54-495f-a43e-7eba5b355947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:37.993461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7bee-ec54-495f-a43e-7eba5b355947 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:37.993797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7bee-ec54-495f-a43e-7eba5b355947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:37.994293 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7bee-ec54-495f-a43e-7eba5b355947 admin admin] PATH_INFO: `/v3/projects/93ac0659e3fd4c14923d75d2bb401596/users/4cc669c9f1f6442ca5fdc322c5be3e45/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:38.011368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7bee-ec54-495f-a43e-7eba5b355947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ac0659e3fd4c14923d75d2bb401596, user_id=4cc669c9f1f6442ca5fdc322c5be3e45, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:38.014174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7bee-ec54-495f-a43e-7eba5b355947 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:38.030579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1242/2488] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:37 2022] PUT /identity/v3/projects/93ac0659e3fd4c14923d75d2bb401596/users/4cc669c9f1f6442ca5fdc322c5be3e45/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:04:38.033706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa3e8-152c-4fff-856a-2da83662fe76 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:38.044738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa3e8-152c-4fff-856a-2da83662fe76 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:38.101431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6069b5c-6dc8-4d21-a662-35f8aefe6036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:38.102101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6069b5c-6dc8-4d21-a662-35f8aefe6036 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:38.102384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6069b5c-6dc8-4d21-a662-35f8aefe6036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:38.102661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6069b5c-6dc8-4d21-a662-35f8aefe6036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:38.103447 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6069b5c-6dc8-4d21-a662-35f8aefe6036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:38.105056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6069b5c-6dc8-4d21-a662-35f8aefe6036 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:38.115491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1247/2489] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:04:38.119976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7bee-ec54-495f-a43e-7eba5b355947 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:38.136087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7bee-ec54-495f-a43e-7eba5b355947 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:38.143114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:38.144529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:38.144975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:38.145400 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] PATH_INFO: `/v3/projects/93ac0659e3fd4c14923d75d2bb401596/users/4cc669c9f1f6442ca5fdc322c5be3e45/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:38.150762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ac0659e3fd4c14923d75d2bb401596, user_id=4cc669c9f1f6442ca5fdc322c5be3e45, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:38.159768 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:38.187764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1243/2490] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:04:38 2022] PUT /identity/v3/projects/93ac0659e3fd4c14923d75d2bb401596/users/4cc669c9f1f6442ca5fdc322c5be3e45/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:04:44.580752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6700-f5c6-4827-91a6-d2ecd9ea1f59 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:44.581355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6700-f5c6-4827-91a6-d2ecd9ea1f59 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:44.581766 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6700-f5c6-4827-91a6-d2ecd9ea1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:44.610793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-04cf6700-f5c6-4827-91a6-d2ecd9ea1f59 None None] MFA Rules not processed for user `4cc669c9f1f6442ca5fdc322c5be3e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:44.612104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-04cf6700-f5c6-4827-91a6-d2ecd9ea1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:44.688072 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1248/2491] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:04:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:44.703127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:44.705378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:44.820007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6b289-205f-4b79-b686-fd6a86403dcf admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:44.827799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:44.830422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:44.830926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:44.831202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:44.892091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:44.894215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:44.904100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1244/2492] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:04:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:04:50.573069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9e672-9668-4e42-8346-9a97aa87a993 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:50.573558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9e672-9668-4e42-8346-9a97aa87a993 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:50.573666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9e672-9668-4e42-8346-9a97aa87a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:50.591644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-aaf9e672-9668-4e42-8346-9a97aa87a993 None None] MFA Rules not processed for user `ee6716ed4ede4bd1819991a607eef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:04:50.592828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-aaf9e672-9668-4e42-8346-9a97aa87a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:50.649474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1249/2493] 10.222.0.93 () {58 vars in 967 bytes} [Wed May 11 19:04:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:04:50.661998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:04:50.663483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:04:50.729871 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb656d4-cf29-423d-b46c-05d63d3eb0e1 service nova] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:04:50.735049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ecac-e394-43e9-9fe0-71286adf7e9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0583c8ab3414ff6b70acf6267ef0d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:04:50.735730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ecac-e394-43e9-9fe0-71286adf7e9b service swift] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:04:50.736012 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ecac-e394-43e9-9fe0-71286adf7e9b service swift] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:04:50.736286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ecac-e394-43e9-9fe0-71286adf7e9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:04:50.745368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ecac-e394-43e9-9fe0-71286adf7e9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:04:50.746973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ecac-e394-43e9-9fe0-71286adf7e9b service swift] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:04:50.756394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1245/2494] 10.222.0.93 () {60 vars in 1384 bytes} [Wed May 11 19:04:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 19:05:03.305822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a739-8ba6-4b79-be7f-54563b12d997 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:03.306299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a739-8ba6-4b79-be7f-54563b12d997 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:03.306411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a739-8ba6-4b79-be7f-54563b12d997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:03.324091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b553a739-8ba6-4b79-be7f-54563b12d997 None None] MFA Rules not processed for user `ead71051e3c548e7989007c8f5d0abc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:03.325271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b553a739-8ba6-4b79-be7f-54563b12d997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:03.332968 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1250/2495] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:25.838827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ecac-e394-43e9-9fe0-71286adf7e9b service swift] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:25.891949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ecac-e394-43e9-9fe0-71286adf7e9b service swift] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:25.895527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:25.896165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:25.896445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:25.896720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:25.898488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:25.958503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:25.959979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:25.969910 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1246/2496] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:28.089537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553a739-8ba6-4b79-be7f-54563b12d997 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:28.091548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b553a739-8ba6-4b79-be7f-54563b12d997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:28.104374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553a739-8ba6-4b79-be7f-54563b12d997 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:28.108842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccacc0-cae0-4364-bc25-e885cc485ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:28.109728 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccacc0-cae0-4364-bc25-e885cc485ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:28.110017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccacc0-cae0-4364-bc25-e885cc485ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:28.110286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccacc0-cae0-4364-bc25-e885cc485ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:28.120399 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccacc0-cae0-4364-bc25-e885cc485ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:28.121871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccacc0-cae0-4364-bc25-e885cc485ff1 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:28.132851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1251/2497] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:29.564407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:29.565861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:29.582077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122aa72-6d4b-4bda-9559-697dee333f94 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:29.587671 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:29.588556 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:29.588834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:29.589129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] PATH_INFO: `/v3/users/f1f10686b4814794aadc34ec6194cc6b` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:29.590311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f10686b4814794aadc34ec6194cc6b)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:29.592795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:29.645665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f10686b4814794aadc34ec6194cc6b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:29.652919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f10686b4814794aadc34ec6194cc6b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:29.654299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f10686b4814794aadc34ec6194cc6b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:29.661769 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f10686b4814794aadc34ec6194cc6b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:29.662391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3af1622a-782c-476b-a72f-5a0dcb27a39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f10686b4814794aadc34ec6194cc6b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:29.684236 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1247/2498] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:29 2022] DELETE /identity/v3/users/f1f10686b4814794aadc34ec6194cc6b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:29.922539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccacc0-cae0-4364-bc25-e885cc485ff1 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:29.936342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccacc0-cae0-4364-bc25-e885cc485ff1 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.004614 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.005612 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.005965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.006320 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] PATH_INFO: `/v3/projects/286035250ee843e696e2422db9319f4f` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.007692 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286035250ee843e696e2422db9319f4f)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.009665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.062705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286035250ee843e696e2422db9319f4f', 'request_id': 'req-4888c304-630e-449f-944e-aacdec81d4e7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:30.072303 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286035250ee843e696e2422db9319f4f', 'request_id': 'req-4888c304-630e-449f-944e-aacdec81d4e7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:30.082198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286035250ee843e696e2422db9319f4f', 'request_id': 'req-4888c304-630e-449f-944e-aacdec81d4e7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:30.104323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] The token cache is being invalidate because project 286035250ee843e696e2422db9319f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:30.104913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:30.107005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4888c304-630e-449f-944e-aacdec81d4e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:30.109060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1252/2499] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:29 2022] DELETE /identity/v3/projects/286035250ee843e696e2422db9319f4f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:30.113888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8be30-90c4-4b2e-b2ca-5113696a81d7 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.114182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8be30-90c4-4b2e-b2ca-5113696a81d7 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.114464 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8be30-90c4-4b2e-b2ca-5113696a81d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.133725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-68b8be30-90c4-4b2e-b2ca-5113696a81d7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:30.135054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-68b8be30-90c4-4b2e-b2ca-5113696a81d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:30.230404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1248/2500] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:30.238741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca1bc1-d57b-475d-8960-6251e1062fc4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.239023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca1bc1-d57b-475d-8960-6251e1062fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.239621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca1bc1-d57b-475d-8960-6251e1062fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.263038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8cca1bc1-d57b-475d-8960-6251e1062fc4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:30.264363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8cca1bc1-d57b-475d-8960-6251e1062fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:30.277942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8be30-90c4-4b2e-b2ca-5113696a81d7 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.289260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1253/2501] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:30.289835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8be30-90c4-4b2e-b2ca-5113696a81d7 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.308987 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.310667 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.311159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.311728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.312698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:05:30.313281 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.315202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.334626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1249/2502] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:05:30.338170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca1bc1-d57b-475d-8960-6251e1062fc4 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.349922 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca1bc1-d57b-475d-8960-6251e1062fc4 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.355738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350e06-f113-4634-86fb-19db1f0a9eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.357050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350e06-f113-4634-86fb-19db1f0a9eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.357436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350e06-f113-4634-86fb-19db1f0a9eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.357787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350e06-f113-4634-86fb-19db1f0a9eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.358735 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350e06-f113-4634-86fb-19db1f0a9eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.360898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350e06-f113-4634-86fb-19db1f0a9eb3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.392161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1254/2503] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:30 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:05:30.396233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.408998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4f10-700e-47e0-a208-c9893649e21c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.474340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa864ee-5ff5-46aa-97ad-494c7b6a7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.475019 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa864ee-5ff5-46aa-97ad-494c7b6a7412 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.475324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa864ee-5ff5-46aa-97ad-494c7b6a7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.475592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa864ee-5ff5-46aa-97ad-494c7b6a7412 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.476285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa864ee-5ff5-46aa-97ad-494c7b6a7412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.478315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa864ee-5ff5-46aa-97ad-494c7b6a7412 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.503313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1250/2504] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:30 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:05:30.508361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350e06-f113-4634-86fb-19db1f0a9eb3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.518737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350e06-f113-4634-86fb-19db1f0a9eb3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.523620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64378041-d454-43fc-8c12-58c7767dd211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.524360 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64378041-d454-43fc-8c12-58c7767dd211 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.524715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64378041-d454-43fc-8c12-58c7767dd211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.524999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64378041-d454-43fc-8c12-58c7767dd211 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.525724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64378041-d454-43fc-8c12-58c7767dd211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.527366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64378041-d454-43fc-8c12-58c7767dd211 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.539236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1255/2505] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:30.543448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa864ee-5ff5-46aa-97ad-494c7b6a7412 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.554130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa864ee-5ff5-46aa-97ad-494c7b6a7412 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.559604 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5872-e2a8-4108-bba8-f34cea574e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.560534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5872-e2a8-4108-bba8-f34cea574e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.561054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5872-e2a8-4108-bba8-f34cea574e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.561533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5872-e2a8-4108-bba8-f34cea574e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.563521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5872-e2a8-4108-bba8-f34cea574e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.565606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5872-e2a8-4108-bba8-f34cea574e50 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.578270 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1251/2506] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:05:30.582668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64378041-d454-43fc-8c12-58c7767dd211 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.593526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64378041-d454-43fc-8c12-58c7767dd211 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.598192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cfeac-656e-4641-ae25-3406ad57839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.599077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cfeac-656e-4641-ae25-3406ad57839c admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.599380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cfeac-656e-4641-ae25-3406ad57839c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.599654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cfeac-656e-4641-ae25-3406ad57839c admin admin] PATH_INFO: `/v3/projects/90a39d4d39e6494eb13841617adb5966/users/251efa25a6d64d95beeec00cc557d5c0/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.614560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cfeac-656e-4641-ae25-3406ad57839c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a39d4d39e6494eb13841617adb5966, user_id=251efa25a6d64d95beeec00cc557d5c0, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.617273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cfeac-656e-4641-ae25-3406ad57839c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.632027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1256/2507] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:30 2022] PUT /identity/v3/projects/90a39d4d39e6494eb13841617adb5966/users/251efa25a6d64d95beeec00cc557d5c0/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:30.642728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0990c7-bfd0-47c5-9f38-b6df3ae8da82 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.643124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0990c7-bfd0-47c5-9f38-b6df3ae8da82 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.643534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0990c7-bfd0-47c5-9f38-b6df3ae8da82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.671503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-7b0990c7-bfd0-47c5-9f38-b6df3ae8da82 None None] MFA Rules not processed for user `251efa25a6d64d95beeec00cc557d5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:30.672753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7b0990c7-bfd0-47c5-9f38-b6df3ae8da82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:30.742497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1252/2508] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:30.747022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cfeac-656e-4641-ae25-3406ad57839c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.811234 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cfeac-656e-4641-ae25-3406ad57839c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.816331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c260-f499-44ff-bf24-5523410f4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.816989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c260-f499-44ff-bf24-5523410f4654 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.817499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c260-f499-44ff-bf24-5523410f4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.817621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c260-f499-44ff-bf24-5523410f4654 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.818226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83c260-f499-44ff-bf24-5523410f4654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.820558 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83c260-f499-44ff-bf24-5523410f4654 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.848129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1257/2509] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:30 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:30.851825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0990c7-bfd0-47c5-9f38-b6df3ae8da82 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.863077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0990c7-bfd0-47c5-9f38-b6df3ae8da82 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.917967 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685daaa3-2d10-41f1-9b71-a7fb55ffea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.918630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daaa3-2d10-41f1-9b71-a7fb55ffea3a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.918929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daaa3-2d10-41f1-9b71-a7fb55ffea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.919203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daaa3-2d10-41f1-9b71-a7fb55ffea3a admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.919943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685daaa3-2d10-41f1-9b71-a7fb55ffea3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.921915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685daaa3-2d10-41f1-9b71-a7fb55ffea3a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.942397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1253/2510] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:30 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:30.946574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c260-f499-44ff-bf24-5523410f4654 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.957669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c260-f499-44ff-bf24-5523410f4654 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.962443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaa377-d59d-42ef-a2f6-9ecad87a3d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.963110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaa377-d59d-42ef-a2f6-9ecad87a3d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.963421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaa377-d59d-42ef-a2f6-9ecad87a3d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.963696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaa377-d59d-42ef-a2f6-9ecad87a3d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:30.964421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaa377-d59d-42ef-a2f6-9ecad87a3d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:30.966578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaa377-d59d-42ef-a2f6-9ecad87a3d9c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:30.977477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1258/2511] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:30.981688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685daaa3-2d10-41f1-9b71-a7fb55ffea3a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:30.992110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685daaa3-2d10-41f1-9b71-a7fb55ffea3a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:30.997933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e01a0-c3e1-48f2-a843-ed47f75ca27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:30.998913 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e01a0-c3e1-48f2-a843-ed47f75ca27c admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:30.999259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e01a0-c3e1-48f2-a843-ed47f75ca27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:30.999725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e01a0-c3e1-48f2-a843-ed47f75ca27c admin admin] PATH_INFO: `/v3/projects/c9964c50c9804b00b65bd9dd73a7b584/users/98d6d7e1fa194d84a1410a32926b7068/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:31.015588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e01a0-c3e1-48f2-a843-ed47f75ca27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9964c50c9804b00b65bd9dd73a7b584, user_id=98d6d7e1fa194d84a1410a32926b7068, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:31.018228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e01a0-c3e1-48f2-a843-ed47f75ca27c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:31.030949 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1254/2512] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:30 2022] PUT /identity/v3/projects/c9964c50c9804b00b65bd9dd73a7b584/users/98d6d7e1fa194d84a1410a32926b7068/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:05:31.034919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaa377-d59d-42ef-a2f6-9ecad87a3d9c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:31.045896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaa377-d59d-42ef-a2f6-9ecad87a3d9c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:31.104620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0930-a05f-42ba-acfa-833ae97dc5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:31.105298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0930-a05f-42ba-acfa-833ae97dc5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:31.105583 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0930-a05f-42ba-acfa-833ae97dc5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:31.105858 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0930-a05f-42ba-acfa-833ae97dc5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:31.107153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d0930-a05f-42ba-acfa-833ae97dc5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:31.108797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d0930-a05f-42ba-acfa-833ae97dc5a6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:31.124619 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1259/2513] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:05:31.125702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e01a0-c3e1-48f2-a843-ed47f75ca27c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:31.136121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e01a0-c3e1-48f2-a843-ed47f75ca27c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:31.140857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:31.141765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:31.142045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:31.142320 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] PATH_INFO: `/v3/projects/c9964c50c9804b00b65bd9dd73a7b584/users/98d6d7e1fa194d84a1410a32926b7068/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:31.144311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9964c50c9804b00b65bd9dd73a7b584, user_id=98d6d7e1fa194d84a1410a32926b7068, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:31.146986 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:31.158625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1255/2514] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:31 2022] PUT /identity/v3/projects/c9964c50c9804b00b65bd9dd73a7b584/users/98d6d7e1fa194d84a1410a32926b7068/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:05:31.168659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144238be-e124-4263-83cf-0e3ddd184a69 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:31.169688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144238be-e124-4263-83cf-0e3ddd184a69 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:31.169959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144238be-e124-4263-83cf-0e3ddd184a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:31.200844 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-144238be-e124-4263-83cf-0e3ddd184a69 None None] MFA Rules not processed for user `98d6d7e1fa194d84a1410a32926b7068`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:31.202153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-144238be-e124-4263-83cf-0e3ddd184a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:31.270422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1260/2515] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:31.282209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:31.284056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:31.347740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7f1c2-3f98-4acf-a0d8-a069ac503d38 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:31.351463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8a640-b0b7-4e9b-a867-b0ec86dd1ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:31.352188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a640-b0b7-4e9b-a867-b0ec86dd1ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:31.352469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a640-b0b7-4e9b-a867-b0ec86dd1ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:31.352745 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a640-b0b7-4e9b-a867-b0ec86dd1ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:31.362237 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8a640-b0b7-4e9b-a867-b0ec86dd1ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:31.363727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8a640-b0b7-4e9b-a867-b0ec86dd1ae6 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:31.373007 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1256/2516] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:31.530608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144238be-e124-4263-83cf-0e3ddd184a69 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:31.593044 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144238be-e124-4263-83cf-0e3ddd184a69 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:31.597537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:31.598403 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:31.598677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:31.598939 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] PATH_INFO: `/v3/users/251efa25a6d64d95beeec00cc557d5c0` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:31.600163 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251efa25a6d64d95beeec00cc557d5c0)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:31.602076 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:31.648958 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251efa25a6d64d95beeec00cc557d5c0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:31.656465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251efa25a6d64d95beeec00cc557d5c0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:31.664310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251efa25a6d64d95beeec00cc557d5c0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:31.664930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251efa25a6d64d95beeec00cc557d5c0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:31.682042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251efa25a6d64d95beeec00cc557d5c0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:31.689195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1261/2517] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:31 2022] DELETE /identity/v3/users/251efa25a6d64d95beeec00cc557d5c0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:31.694254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdc448-1f69-4cd9-8544-86df42e67696 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:31.694744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdc448-1f69-4cd9-8544-86df42e67696 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:31.694836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdc448-1f69-4cd9-8544-86df42e67696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:31.711988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-49cdc448-1f69-4cd9-8544-86df42e67696 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:31.713173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-49cdc448-1f69-4cd9-8544-86df42e67696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:31.769559 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1257/2518] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:31.779666 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:31.781106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:31.836259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cff08-1531-480a-b088-04760c1cb8d6 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:31.839936 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa65cd3-148f-4205-814a-5ea61d476ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:31.840572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa65cd3-148f-4205-814a-5ea61d476ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:31.841346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa65cd3-148f-4205-814a-5ea61d476ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:31.841622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa65cd3-148f-4205-814a-5ea61d476ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:31.850499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa65cd3-148f-4205-814a-5ea61d476ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:31.851971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa65cd3-148f-4205-814a-5ea61d476ec5 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:31.861814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1262/2519] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:32.114805 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdc448-1f69-4cd9-8544-86df42e67696 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:32.116245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-49cdc448-1f69-4cd9-8544-86df42e67696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:32.130109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdc448-1f69-4cd9-8544-86df42e67696 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:32.135210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:32.136332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:32.136546 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:32.136822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] PATH_INFO: `/v3/projects/90a39d4d39e6494eb13841617adb5966` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:32.138737 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a39d4d39e6494eb13841617adb5966)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:32.140712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:32.187004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a39d4d39e6494eb13841617adb5966', 'request_id': 'req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.192401 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a39d4d39e6494eb13841617adb5966', 'request_id': 'req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.202570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a39d4d39e6494eb13841617adb5966', 'request_id': 'req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.214712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] The token cache is being invalidate because project 90a39d4d39e6494eb13841617adb5966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:32.214996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.215787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.217916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1258/2520] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:32 2022] DELETE /identity/v3/projects/90a39d4d39e6494eb13841617adb5966 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:32.222063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa65cd3-148f-4205-814a-5ea61d476ec5 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:32.231964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa65cd3-148f-4205-814a-5ea61d476ec5 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:32.287448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:32.288329 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:32.288606 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:32.288876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] PATH_INFO: `/v3/users/98d6d7e1fa194d84a1410a32926b7068` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:32.290144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d6d7e1fa194d84a1410a32926b7068)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:32.292061 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:32.336373 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d6d7e1fa194d84a1410a32926b7068'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.344123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d6d7e1fa194d84a1410a32926b7068'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.350914 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d6d7e1fa194d84a1410a32926b7068'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.351555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d6d7e1fa194d84a1410a32926b7068'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.363322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-02005295-a3b8-467b-83df-a69dc2a635ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d6d7e1fa194d84a1410a32926b7068'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:32.371403 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1263/2521] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:32 2022] DELETE /identity/v3/users/98d6d7e1fa194d84a1410a32926b7068 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:32.902720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:32.904383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:32.919893 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4d716-ab0a-4e3b-a269-1ea9c8d9f2db admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:32.979416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:32.980292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:32.980572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:32.980845 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] PATH_INFO: `/v3/projects/c9964c50c9804b00b65bd9dd73a7b584` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:32.982641 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9964c50c9804b00b65bd9dd73a7b584)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:32.984594 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.029914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9964c50c9804b00b65bd9dd73a7b584', 'request_id': 'req-f34d5132-e985-487f-8d09-c4db7ffb3029'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:33.035502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9964c50c9804b00b65bd9dd73a7b584', 'request_id': 'req-f34d5132-e985-487f-8d09-c4db7ffb3029'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:33.042789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9964c50c9804b00b65bd9dd73a7b584', 'request_id': 'req-f34d5132-e985-487f-8d09-c4db7ffb3029'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:33.054331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] The token cache is being invalidate because project c9964c50c9804b00b65bd9dd73a7b584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:33.054545 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:33.055164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-f34d5132-e985-487f-8d09-c4db7ffb3029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:33.056744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1259/2522] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:32 2022] DELETE /identity/v3/projects/c9964c50c9804b00b65bd9dd73a7b584 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:05:33.062112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438120d-b56d-4775-b039-6e702c81adc5 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.062409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438120d-b56d-4775-b039-6e702c81adc5 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.062681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438120d-b56d-4775-b039-6e702c81adc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.082022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d438120d-b56d-4775-b039-6e702c81adc5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:33.083250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d438120d-b56d-4775-b039-6e702c81adc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:33.140680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1264/2523] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:33.148430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db860-9222-4bee-a311-086890536f03 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.148713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db860-9222-4bee-a311-086890536f03 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.148982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db860-9222-4bee-a311-086890536f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.168371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-475db860-9222-4bee-a311-086890536f03 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:33.170267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-475db860-9222-4bee-a311-086890536f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:33.178249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1260/2524] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:33.182488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438120d-b56d-4775-b039-6e702c81adc5 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.192926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438120d-b56d-4775-b039-6e702c81adc5 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.203349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.204035 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.204316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.204589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.205321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:05:33.205622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.207243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.220080 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1265/2525] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:05:33.224343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475db860-9222-4bee-a311-086890536f03 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.235421 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475db860-9222-4bee-a311-086890536f03 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.240062 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e25184-a085-4ed9-af58-5899d4121053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.240714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e25184-a085-4ed9-af58-5899d4121053 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.240994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e25184-a085-4ed9-af58-5899d4121053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.241306 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e25184-a085-4ed9-af58-5899d4121053 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.242092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e25184-a085-4ed9-af58-5899d4121053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.244033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e25184-a085-4ed9-af58-5899d4121053 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.273713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1261/2526] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:33 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:05:33.275127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.285590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4d223-bf90-4022-8b97-39305c987fd7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.343610 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269a99b-3395-4267-a672-1f3b85a6900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.344290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a99b-3395-4267-a672-1f3b85a6900e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.344571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a99b-3395-4267-a672-1f3b85a6900e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.344872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a99b-3395-4267-a672-1f3b85a6900e admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.345570 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269a99b-3395-4267-a672-1f3b85a6900e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.347516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269a99b-3395-4267-a672-1f3b85a6900e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.367431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1266/2527] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:33 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:33.371660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e25184-a085-4ed9-af58-5899d4121053 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.381721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e25184-a085-4ed9-af58-5899d4121053 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.386305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f215-12c6-41f2-bbc8-85dbe8deac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.386953 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f215-12c6-41f2-bbc8-85dbe8deac79 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.387231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f215-12c6-41f2-bbc8-85dbe8deac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.387567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f215-12c6-41f2-bbc8-85dbe8deac79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.388285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f215-12c6-41f2-bbc8-85dbe8deac79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.389886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f215-12c6-41f2-bbc8-85dbe8deac79 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.400211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1262/2528] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:33.404699 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269a99b-3395-4267-a672-1f3b85a6900e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.415007 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269a99b-3395-4267-a672-1f3b85a6900e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.420862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ff06f-5c76-411f-956c-d6d3119b386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.421758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ff06f-5c76-411f-956c-d6d3119b386f admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.422036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ff06f-5c76-411f-956c-d6d3119b386f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.422498 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ff06f-5c76-411f-956c-d6d3119b386f admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.423232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ff06f-5c76-411f-956c-d6d3119b386f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.424878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ff06f-5c76-411f-956c-d6d3119b386f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.435148 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1267/2529] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:33.439396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f215-12c6-41f2-bbc8-85dbe8deac79 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.450529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f215-12c6-41f2-bbc8-85dbe8deac79 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.455740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e940cb9-eb13-482e-b905-b228a8c66f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.461115 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e940cb9-eb13-482e-b905-b228a8c66f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.461406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e940cb9-eb13-482e-b905-b228a8c66f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.461687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e940cb9-eb13-482e-b905-b228a8c66f1e admin admin] PATH_INFO: `/v3/projects/23144899136248f5a22439edb95b7ab5/users/f920376cf4304fc995c24461bf77f55b/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.477946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e940cb9-eb13-482e-b905-b228a8c66f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23144899136248f5a22439edb95b7ab5, user_id=f920376cf4304fc995c24461bf77f55b, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.480577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e940cb9-eb13-482e-b905-b228a8c66f1e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.506200 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1263/2530] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:33 2022] PUT /identity/v3/projects/23144899136248f5a22439edb95b7ab5/users/f920376cf4304fc995c24461bf77f55b/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:33.509786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5261-b05c-401a-8acb-daf60e699ada None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.510183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5261-b05c-401a-8acb-daf60e699ada None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.510628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5261-b05c-401a-8acb-daf60e699ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.563730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-ad7d5261-b05c-401a-8acb-daf60e699ada None None] MFA Rules not processed for user `f920376cf4304fc995c24461bf77f55b`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:33.564987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-ad7d5261-b05c-401a-8acb-daf60e699ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:33.687190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1268/2531] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:33.691450 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e940cb9-eb13-482e-b905-b228a8c66f1e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.771318 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e940cb9-eb13-482e-b905-b228a8c66f1e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.777821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e09004-fc76-4664-ae0c-5129c1e3654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.779660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09004-fc76-4664-ae0c-5129c1e3654a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.780193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09004-fc76-4664-ae0c-5129c1e3654a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.780680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09004-fc76-4664-ae0c-5129c1e3654a admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.781696 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e09004-fc76-4664-ae0c-5129c1e3654a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.783883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e09004-fc76-4664-ae0c-5129c1e3654a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.819847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1264/2532] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:33 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:05:33.823709 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5261-b05c-401a-8acb-daf60e699ada None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.835176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5261-b05c-401a-8acb-daf60e699ada None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.901283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce1652-be24-4442-9047-c92c10fafd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.901970 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce1652-be24-4442-9047-c92c10fafd7e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.902267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce1652-be24-4442-9047-c92c10fafd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.902667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce1652-be24-4442-9047-c92c10fafd7e admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.904299 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce1652-be24-4442-9047-c92c10fafd7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.912393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce1652-be24-4442-9047-c92c10fafd7e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.939935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1269/2533] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:33 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:33.944073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e09004-fc76-4664-ae0c-5129c1e3654a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.956466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e09004-fc76-4664-ae0c-5129c1e3654a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:33.961712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17272443-f381-4e76-8a05-cdc11e44c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:33.963267 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17272443-f381-4e76-8a05-cdc11e44c19e admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:33.963799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17272443-f381-4e76-8a05-cdc11e44c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:33.965138 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17272443-f381-4e76-8a05-cdc11e44c19e admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:33.966649 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17272443-f381-4e76-8a05-cdc11e44c19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:33.968587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17272443-f381-4e76-8a05-cdc11e44c19e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:33.980705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1265/2534] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:05:33.984688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce1652-be24-4442-9047-c92c10fafd7e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:33.998557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce1652-be24-4442-9047-c92c10fafd7e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:34.002110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d11e-e73c-4037-9b6e-0a2f2f681570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:34.003124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d11e-e73c-4037-9b6e-0a2f2f681570 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:34.003588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d11e-e73c-4037-9b6e-0a2f2f681570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:34.003964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d11e-e73c-4037-9b6e-0a2f2f681570 admin admin] PATH_INFO: `/v3/projects/fc6948b10f5644c38a16f5046dbf2bd5/users/7e5f330842ed42eea31261c50e14d522/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:34.044839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813d11e-e73c-4037-9b6e-0a2f2f681570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6948b10f5644c38a16f5046dbf2bd5, user_id=7e5f330842ed42eea31261c50e14d522, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:34.047555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813d11e-e73c-4037-9b6e-0a2f2f681570 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:34.061868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1270/2535] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:33 2022] PUT /identity/v3/projects/fc6948b10f5644c38a16f5046dbf2bd5/users/7e5f330842ed42eea31261c50e14d522/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:34.065903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17272443-f381-4e76-8a05-cdc11e44c19e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:34.076961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17272443-f381-4e76-8a05-cdc11e44c19e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:34.132319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82ca9d-cda1-46bb-bff8-9644a50afc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:34.132899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ca9d-cda1-46bb-bff8-9644a50afc56 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:34.133172 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ca9d-cda1-46bb-bff8-9644a50afc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:34.133445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ca9d-cda1-46bb-bff8-9644a50afc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:34.134169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82ca9d-cda1-46bb-bff8-9644a50afc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:34.135834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82ca9d-cda1-46bb-bff8-9644a50afc56 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:34.146283 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1266/2536] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:05:34.150436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d11e-e73c-4037-9b6e-0a2f2f681570 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:34.160806 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d11e-e73c-4037-9b6e-0a2f2f681570 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:34.165466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:34.166344 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:34.166623 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:34.166926 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] PATH_INFO: `/v3/projects/fc6948b10f5644c38a16f5046dbf2bd5/users/7e5f330842ed42eea31261c50e14d522/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:34.168964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6948b10f5644c38a16f5046dbf2bd5, user_id=7e5f330842ed42eea31261c50e14d522, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:34.171641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:34.182283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1271/2537] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:34 2022] PUT /identity/v3/projects/fc6948b10f5644c38a16f5046dbf2bd5/users/7e5f330842ed42eea31261c50e14d522/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:05:34.194094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa6da-2dc6-4d74-a7b6-eaf40fb661a2 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:34.194388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa6da-2dc6-4d74-a7b6-eaf40fb661a2 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:34.194670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa6da-2dc6-4d74-a7b6-eaf40fb661a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:34.223077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d64fa6da-2dc6-4d74-a7b6-eaf40fb661a2 None None] MFA Rules not processed for user `7e5f330842ed42eea31261c50e14d522`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:34.224363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d64fa6da-2dc6-4d74-a7b6-eaf40fb661a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:34.296269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1267/2538] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:34.308322 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:34.310749 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:34.368879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a4652-eb0f-4188-959c-22969f1eddde admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:34.373051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbe739-54ef-4f3a-8338-ade46db35a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:34.373691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbe739-54ef-4f3a-8338-ade46db35a3b service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:34.373965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbe739-54ef-4f3a-8338-ade46db35a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:34.374232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbe739-54ef-4f3a-8338-ade46db35a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:34.383539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbe739-54ef-4f3a-8338-ade46db35a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:34.385002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbe739-54ef-4f3a-8338-ade46db35a3b service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:34.394799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1272/2539] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:34.423670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa6da-2dc6-4d74-a7b6-eaf40fb661a2 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:34.486402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa6da-2dc6-4d74-a7b6-eaf40fb661a2 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:34.490933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:34.491823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:34.492105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:34.492506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] PATH_INFO: `/v3/users/f920376cf4304fc995c24461bf77f55b` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:34.493698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f920376cf4304fc995c24461bf77f55b)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:34.495666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:34.542773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f920376cf4304fc995c24461bf77f55b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:34.551039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f920376cf4304fc995c24461bf77f55b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:34.551808 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f920376cf4304fc995c24461bf77f55b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:34.559735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f920376cf4304fc995c24461bf77f55b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:34.560432 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f920376cf4304fc995c24461bf77f55b'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:34.579933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1268/2540] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:34 2022] DELETE /identity/v3/users/f920376cf4304fc995c24461bf77f55b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:34.584584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22450a55-469c-4757-bf67-c1b5e459771a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:34.584876 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22450a55-469c-4757-bf67-c1b5e459771a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:34.585151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22450a55-469c-4757-bf67-c1b5e459771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:34.603137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-22450a55-469c-4757-bf67-c1b5e459771a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:34.604401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-22450a55-469c-4757-bf67-c1b5e459771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:34.675536 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1273/2541] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:34.684914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:34.686447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:34.755523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edced5a-0ed5-466e-ae4a-3f7f669e23b3 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:34.759284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecab3a-a319-411a-9343-ec723c2a5089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:34.759984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecab3a-a319-411a-9343-ec723c2a5089 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:34.760292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecab3a-a319-411a-9343-ec723c2a5089 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:34.760568 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecab3a-a319-411a-9343-ec723c2a5089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:34.771174 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecab3a-a319-411a-9343-ec723c2a5089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:34.772755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecab3a-a319-411a-9343-ec723c2a5089 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:34.782803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1269/2542] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:35.042137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22450a55-469c-4757-bf67-c1b5e459771a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:35.044720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-22450a55-469c-4757-bf67-c1b5e459771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:35.069053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22450a55-469c-4757-bf67-c1b5e459771a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:35.077182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:35.078665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:35.079140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:35.079742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] PATH_INFO: `/v3/projects/23144899136248f5a22439edb95b7ab5` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:35.081795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23144899136248f5a22439edb95b7ab5)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:35.085650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:35.148577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23144899136248f5a22439edb95b7ab5', 'request_id': 'req-be976489-4107-4c5a-9792-40f4c92ac825'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.156754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23144899136248f5a22439edb95b7ab5', 'request_id': 'req-be976489-4107-4c5a-9792-40f4c92ac825'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.162620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23144899136248f5a22439edb95b7ab5', 'request_id': 'req-be976489-4107-4c5a-9792-40f4c92ac825'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.176284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] The token cache is being invalidate because project 23144899136248f5a22439edb95b7ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:35.176565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.177238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.178786 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1274/2543] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:35 2022] DELETE /identity/v3/projects/23144899136248f5a22439edb95b7ab5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:35.182748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecab3a-a319-411a-9343-ec723c2a5089 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:35.193050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecab3a-a319-411a-9343-ec723c2a5089 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:35.252478 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:35.253373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:35.253666 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:35.254042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] PATH_INFO: `/v3/users/7e5f330842ed42eea31261c50e14d522` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:35.255271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5f330842ed42eea31261c50e14d522)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:35.257342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:35.303103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5f330842ed42eea31261c50e14d522'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.309751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5f330842ed42eea31261c50e14d522'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.310404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5f330842ed42eea31261c50e14d522'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.317135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5f330842ed42eea31261c50e14d522'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.317744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c2ded33e-4c36-49c5-aadb-75576915b01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5f330842ed42eea31261c50e14d522'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.335004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1270/2544] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:35 2022] DELETE /identity/v3/users/7e5f330842ed42eea31261c50e14d522 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:35.606777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:35.608283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:35.620909 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be976489-4107-4c5a-9792-40f4c92ac825 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:35.681434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:35.682223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:35.682503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:35.682778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] PATH_INFO: `/v3/projects/fc6948b10f5644c38a16f5046dbf2bd5` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:35.683978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6948b10f5644c38a16f5046dbf2bd5)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:35.686434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:35.730704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6948b10f5644c38a16f5046dbf2bd5', 'request_id': 'req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.737660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6948b10f5644c38a16f5046dbf2bd5', 'request_id': 'req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.742965 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6948b10f5644c38a16f5046dbf2bd5', 'request_id': 'req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.754445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] The token cache is being invalidate because project fc6948b10f5644c38a16f5046dbf2bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:35.754725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.755370 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-1f4b1f74-b0fd-4e24-b05e-b6eea6d83a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:35.756896 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1275/2545] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:35 2022] DELETE /identity/v3/projects/fc6948b10f5644c38a16f5046dbf2bd5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:35.763100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebf54f-5236-458d-98f7-38823581f289 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:35.763426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebf54f-5236-458d-98f7-38823581f289 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:35.763699 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebf54f-5236-458d-98f7-38823581f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:35.781191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-38ebf54f-5236-458d-98f7-38823581f289 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:35.782379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-38ebf54f-5236-458d-98f7-38823581f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:35.838353 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1271/2546] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:35.846021 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a4b5-8f36-44e6-9121-8515e2ba11d3 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:35.846308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a4b5-8f36-44e6-9121-8515e2ba11d3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:35.846585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a4b5-8f36-44e6-9121-8515e2ba11d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:35.864847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-4205a4b5-8f36-44e6-9121-8515e2ba11d3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:35.866040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4205a4b5-8f36-44e6-9121-8515e2ba11d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:35.874347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1276/2547] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:35.878309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebf54f-5236-458d-98f7-38823581f289 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:35.888061 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebf54f-5236-458d-98f7-38823581f289 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:35.892491 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:35.893129 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:35.893405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:35.893676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:35.894385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:05:35.894684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:35.896289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:35.907477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1272/2548] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:05:35.911488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a4b5-8f36-44e6-9121-8515e2ba11d3 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:35.921089 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a4b5-8f36-44e6-9121-8515e2ba11d3 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:35.925667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3c57-e382-4dd2-89f4-1c65ce74f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:35.926304 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3c57-e382-4dd2-89f4-1c65ce74f424 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:35.926584 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3c57-e382-4dd2-89f4-1c65ce74f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:35.926856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3c57-e382-4dd2-89f4-1c65ce74f424 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:35.927565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3c57-e382-4dd2-89f4-1c65ce74f424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:35.929455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3c57-e382-4dd2-89f4-1c65ce74f424 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:35.957250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1277/2549] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:35 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:35.958684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:35.968634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ca6e-e497-4322-9355-84d9052b6f24 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:36.024420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4300d32-d8af-4c79-ab73-39f6ae3336a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:36.025252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300d32-d8af-4c79-ab73-39f6ae3336a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.025632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300d32-d8af-4c79-ab73-39f6ae3336a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.026008 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300d32-d8af-4c79-ab73-39f6ae3336a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.026844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4300d32-d8af-4c79-ab73-39f6ae3336a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:36.029031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4300d32-d8af-4c79-ab73-39f6ae3336a2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:36.052235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1273/2550] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:35 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:36.056259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3c57-e382-4dd2-89f4-1c65ce74f424 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:36.067864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3c57-e382-4dd2-89f4-1c65ce74f424 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:36.073125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe612140-37e1-4954-be6a-7223958548ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:36.073935 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe612140-37e1-4954-be6a-7223958548ce admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.074239 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe612140-37e1-4954-be6a-7223958548ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.074640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe612140-37e1-4954-be6a-7223958548ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.075448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe612140-37e1-4954-be6a-7223958548ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:36.077062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe612140-37e1-4954-be6a-7223958548ce admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:36.087971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1278/2551] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:36.091980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4300d32-d8af-4c79-ab73-39f6ae3336a2 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:36.101955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4300d32-d8af-4c79-ab73-39f6ae3336a2 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:36.106988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dbc36-488d-4989-bb1c-2829c1de8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:36.107662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dbc36-488d-4989-bb1c-2829c1de8b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.107938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dbc36-488d-4989-bb1c-2829c1de8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.108205 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dbc36-488d-4989-bb1c-2829c1de8b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.108947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dbc36-488d-4989-bb1c-2829c1de8b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:36.110516 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dbc36-488d-4989-bb1c-2829c1de8b63 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:36.120127 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1274/2552] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:05:36.124716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe612140-37e1-4954-be6a-7223958548ce admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:36.134436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe612140-37e1-4954-be6a-7223958548ce admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:36.139075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:36.139984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.140264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.140566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] PATH_INFO: `/v3/projects/ca2cd40c171c4f29ada388f76fa326d7/users/5b804c6ccc834536ae3cc7bd610b2697/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.154600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2cd40c171c4f29ada388f76fa326d7, user_id=5b804c6ccc834536ae3cc7bd610b2697, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:36.157273 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:36.170661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1279/2553] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:36 2022] PUT /identity/v3/projects/ca2cd40c171c4f29ada388f76fa326d7/users/5b804c6ccc834536ae3cc7bd610b2697/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:36.180885 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c79d8-c988-4c18-8cb1-8615b93f599f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.181396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c79d8-c988-4c18-8cb1-8615b93f599f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.181938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c79d8-c988-4c18-8cb1-8615b93f599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.222721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-f83c79d8-c988-4c18-8cb1-8615b93f599f None None] MFA Rules not processed for user `5b804c6ccc834536ae3cc7bd610b2697`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:36.225240 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f83c79d8-c988-4c18-8cb1-8615b93f599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:36.339919 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1275/2554] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:36.354090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:36.356010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:36.430325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7d41f-a7fb-47e2-890d-a612600b78f5 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:36.439995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:36.440725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.441008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.441285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.455001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:36.457136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:36.468096 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1280/2555] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:36.489731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c79d8-c988-4c18-8cb1-8615b93f599f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:36.556625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c79d8-c988-4c18-8cb1-8615b93f599f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:36.562555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:36.563732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.564513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.564908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] PATH_INFO: `/v3/users/5b804c6ccc834536ae3cc7bd610b2697` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.566291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b804c6ccc834536ae3cc7bd610b2697)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:36.568764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:36.601462 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:36.603039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:36.625356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b804c6ccc834536ae3cc7bd610b2697'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:36.632595 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b804c6ccc834536ae3cc7bd610b2697'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:36.633311 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b804c6ccc834536ae3cc7bd610b2697'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:36.642753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b804c6ccc834536ae3cc7bd610b2697'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:36.643756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-871e10fb-6a41-403c-9e98-2496221b83c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b804c6ccc834536ae3cc7bd610b2697'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:36.671611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1276/2556] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:36 2022] DELETE /identity/v3/users/5b804c6ccc834536ae3cc7bd610b2697 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:36.675675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ed0f-dd86-4c62-a258-f5f820a6ea94 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.676146 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ed0f-dd86-4c62-a258-f5f820a6ea94 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.676573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ed0f-dd86-4c62-a258-f5f820a6ea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.701212 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec93a-ff4e-4042-8d18-0c2efc0ea1c3 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:36.701826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-1db6ed0f-dd86-4c62-a258-f5f820a6ea94 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:36.702617 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1db6ed0f-dd86-4c62-a258-f5f820a6ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:36.760139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dccfa9-3872-44e4-b179-d730af414940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:36.761091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dccfa9-3872-44e4-b179-d730af414940 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.761522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dccfa9-3872-44e4-b179-d730af414940 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.761938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dccfa9-3872-44e4-b179-d730af414940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.764468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e4dccfa9-3872-44e4-b179-d730af414940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:36.783373 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1277/2557] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:36.796305 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6ed0f-dd86-4c62-a258-f5f820a6ea94 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:36.799191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1db6ed0f-dd86-4c62-a258-f5f820a6ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:36.817834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6ed0f-dd86-4c62-a258-f5f820a6ea94 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:36.823837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:36.824499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:36.825540 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:36.825826 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:36.846526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:36.848097 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:36.859124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1278/2558] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:05:36.872916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dccfa9-3872-44e4-b179-d730af414940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:36.874633 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dccfa9-3872-44e4-b179-d730af414940 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:36.885795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1281/2559] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:05:37.295185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:37.296820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:37.314553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b7d2-97ac-4c44-adb2-9c9effe57945 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:37.320540 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:37.321656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.322645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.322920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] PATH_INFO: `/v3/projects/ca2cd40c171c4f29ada388f76fa326d7` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.324377 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2cd40c171c4f29ada388f76fa326d7)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:37.327038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:37.381726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2cd40c171c4f29ada388f76fa326d7', 'request_id': 'req-0f427aeb-9dde-4431-83a0-6c2849677c54'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:37.389846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2cd40c171c4f29ada388f76fa326d7', 'request_id': 'req-0f427aeb-9dde-4431-83a0-6c2849677c54'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:37.400052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2cd40c171c4f29ada388f76fa326d7', 'request_id': 'req-0f427aeb-9dde-4431-83a0-6c2849677c54'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:37.412709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] The token cache is being invalidate because project ca2cd40c171c4f29ada388f76fa326d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:37.413029 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:37.413682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0f427aeb-9dde-4431-83a0-6c2849677c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:37.415327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1279/2560] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:37 2022] DELETE /identity/v3/projects/ca2cd40c171c4f29ada388f76fa326d7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:37.420330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776495d-4df3-44fc-82e3-5a15d745c504 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.420989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776495d-4df3-44fc-82e3-5a15d745c504 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.421269 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776495d-4df3-44fc-82e3-5a15d745c504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.443020 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-0776495d-4df3-44fc-82e3-5a15d745c504 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:37.444698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0776495d-4df3-44fc-82e3-5a15d745c504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:37.514978 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1282/2561] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:37.523839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ffcbc-380c-4666-9f03-17cb8b399aaf None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.524399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ffcbc-380c-4666-9f03-17cb8b399aaf None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.524679 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ffcbc-380c-4666-9f03-17cb8b399aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.546037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-575ffcbc-380c-4666-9f03-17cb8b399aaf None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:37.547329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-575ffcbc-380c-4666-9f03-17cb8b399aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:37.557108 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1280/2562] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:37.561484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776495d-4df3-44fc-82e3-5a15d745c504 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:37.572208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776495d-4df3-44fc-82e3-5a15d745c504 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:37.580115 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:37.581381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.581800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.582178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.583255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:05:37.583701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:37.585591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:37.603176 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1283/2563] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:05:37.606158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ffcbc-380c-4666-9f03-17cb8b399aaf None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:37.616417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ffcbc-380c-4666-9f03-17cb8b399aaf None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:37.622555 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df65b3-acd6-43f3-b601-b898c1e55cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:37.623493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df65b3-acd6-43f3-b601-b898c1e55cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.624106 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df65b3-acd6-43f3-b601-b898c1e55cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.624530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df65b3-acd6-43f3-b601-b898c1e55cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.626369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df65b3-acd6-43f3-b601-b898c1e55cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:37.629000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df65b3-acd6-43f3-b601-b898c1e55cc5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:37.665232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1281/2564] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:37 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:37.670122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:37.684361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad631f1a-0c71-4d13-b018-b238d05f4a9c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:37.817954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721cc6-31c3-4a08-9875-34892242133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:37.819934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721cc6-31c3-4a08-9875-34892242133e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.820422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721cc6-31c3-4a08-9875-34892242133e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.820883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721cc6-31c3-4a08-9875-34892242133e admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.822204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85721cc6-31c3-4a08-9875-34892242133e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:37.824485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85721cc6-31c3-4a08-9875-34892242133e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:37.861014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1284/2565] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:37 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:37.865193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df65b3-acd6-43f3-b601-b898c1e55cc5 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:37.876662 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df65b3-acd6-43f3-b601-b898c1e55cc5 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:37.882446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258de55-7a5a-47c9-9245-e95fd0a4d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:37.883658 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258de55-7a5a-47c9-9245-e95fd0a4d4fe admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.884272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258de55-7a5a-47c9-9245-e95fd0a4d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.884755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258de55-7a5a-47c9-9245-e95fd0a4d4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.885781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258de55-7a5a-47c9-9245-e95fd0a4d4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:37.888314 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258de55-7a5a-47c9-9245-e95fd0a4d4fe admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:37.908757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1282/2566] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:37.909561 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721cc6-31c3-4a08-9875-34892242133e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:37.921297 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721cc6-31c3-4a08-9875-34892242133e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:37.926590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f77038-f4da-4bea-aeed-c963cc2ed666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:37.927266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77038-f4da-4bea-aeed-c963cc2ed666 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.927573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77038-f4da-4bea-aeed-c963cc2ed666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.927991 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77038-f4da-4bea-aeed-c963cc2ed666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.928724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f77038-f4da-4bea-aeed-c963cc2ed666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:37.930608 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f77038-f4da-4bea-aeed-c963cc2ed666 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:37.947358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1285/2567] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:05:37.948749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258de55-7a5a-47c9-9245-e95fd0a4d4fe admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:37.959951 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258de55-7a5a-47c9-9245-e95fd0a4d4fe admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:37.966965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:37.967922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:37.968201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:37.968608 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] PATH_INFO: `/v3/projects/00418919e0804082942d900d49cceb18/users/0702a357415e4edbbb7a452fbdf4260c/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:37.985380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00418919e0804082942d900d49cceb18, user_id=0702a357415e4edbbb7a452fbdf4260c, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:37.988075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:38.001932 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1283/2568] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:37 2022] PUT /identity/v3/projects/00418919e0804082942d900d49cceb18/users/0702a357415e4edbbb7a452fbdf4260c/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:38.012296 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9fde-177f-450b-acb1-fb9d8769e685 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:38.014102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9fde-177f-450b-acb1-fb9d8769e685 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:38.014348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9fde-177f-450b-acb1-fb9d8769e685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:38.043627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9b2b9fde-177f-450b-acb1-fb9d8769e685 None None] MFA Rules not processed for user `0702a357415e4edbbb7a452fbdf4260c`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:38.044796 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9b2b9fde-177f-450b-acb1-fb9d8769e685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:38.125932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1286/2569] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:38.137216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:38.139085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:38.203489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0f326-910a-4ea7-b280-c643e231b56d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:38.211586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:38.211988 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:38.212276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:38.212589 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:38.221945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:38.224082 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:38.237549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1284/2570] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:40.774771 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b9fde-177f-450b-acb1-fb9d8769e685 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:40.776170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9b2b9fde-177f-450b-acb1-fb9d8769e685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:40.830593 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b9fde-177f-450b-acb1-fb9d8769e685 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:40.834116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:40.834743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:40.835019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:40.835288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:40.837041 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:40.896464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:40.897929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:40.907859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1287/2571] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:44.753350 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:44.755280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:44.787414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d769c0-7e70-4e66-be63-501db6c8a3b8 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:44.792252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:44.793124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:44.793442 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:44.793721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] PATH_INFO: `/v3/users/f8edf1e5f81c4e81b346c82cb48a47f6` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:44.794926 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8edf1e5f81c4e81b346c82cb48a47f6)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:44.796876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:44.858224 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8edf1e5f81c4e81b346c82cb48a47f6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:44.867412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8edf1e5f81c4e81b346c82cb48a47f6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:44.868164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8edf1e5f81c4e81b346c82cb48a47f6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:44.876326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8edf1e5f81c4e81b346c82cb48a47f6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:44.876968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-eeae1e42-d420-406b-bc48-bfd929ffb75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8edf1e5f81c4e81b346c82cb48a47f6'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:44.897979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1285/2572] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:44 2022] DELETE /identity/v3/users/f8edf1e5f81c4e81b346c82cb48a47f6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:45.067487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.077454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3a76-8d25-42f1-8262-0cac2d36d9c6 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.136333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.137119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.137542 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.137644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] PATH_INFO: `/v3/projects/35ad10e77d194397ba6a84cf39758839` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.138818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ad10e77d194397ba6a84cf39758839)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.140762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.187211 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ad10e77d194397ba6a84cf39758839', 'request_id': 'req-85646d4f-b7a1-4786-9897-50be7ac0384a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:45.194790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ad10e77d194397ba6a84cf39758839', 'request_id': 'req-85646d4f-b7a1-4786-9897-50be7ac0384a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:45.200789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ad10e77d194397ba6a84cf39758839', 'request_id': 'req-85646d4f-b7a1-4786-9897-50be7ac0384a'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:45.212005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] The token cache is being invalidate because project 35ad10e77d194397ba6a84cf39758839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:45.212291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:45.212931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-85646d4f-b7a1-4786-9897-50be7ac0384a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:45.214485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1288/2573] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:45 2022] DELETE /identity/v3/projects/35ad10e77d194397ba6a84cf39758839 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:45.219480 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b337-8f55-409d-9242-cc2e90907eef None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.219774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b337-8f55-409d-9242-cc2e90907eef None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.220056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b337-8f55-409d-9242-cc2e90907eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.237890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-33b9b337-8f55-409d-9242-cc2e90907eef None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:45.239113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-33b9b337-8f55-409d-9242-cc2e90907eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:45.297371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1286/2574] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:45.305222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6afb9b-2b4a-490c-ad83-f87d8495a6ee None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.305506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6afb9b-2b4a-490c-ad83-f87d8495a6ee None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.305810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6afb9b-2b4a-490c-ad83-f87d8495a6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.324275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9d6afb9b-2b4a-490c-ad83-f87d8495a6ee None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:45.325496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9d6afb9b-2b4a-490c-ad83-f87d8495a6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:45.333450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1289/2575] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:45.337343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9b337-8f55-409d-9242-cc2e90907eef None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.347762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9b337-8f55-409d-9242-cc2e90907eef None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.353186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.353840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.354116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.354385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.355102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:05:45.355453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.357638 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.369465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1287/2576] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:05:45.373675 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6afb9b-2b4a-490c-ad83-f87d8495a6ee None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.382691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6afb9b-2b4a-490c-ad83-f87d8495a6ee None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.387549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb76de-deaa-48e0-bc50-ce30421c39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.388140 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb76de-deaa-48e0-bc50-ce30421c39fc admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.388421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb76de-deaa-48e0-bc50-ce30421c39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.388698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb76de-deaa-48e0-bc50-ce30421c39fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.389438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb76de-deaa-48e0-bc50-ce30421c39fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.391369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb76de-deaa-48e0-bc50-ce30421c39fc admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.415954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1290/2577] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:45 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:45.420518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.430340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c9643-823b-4bc1-94a8-832c79ed3ea2 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.488850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10085e-69dc-4139-966e-0197ca3b3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.489521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10085e-69dc-4139-966e-0197ca3b3bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.489814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10085e-69dc-4139-966e-0197ca3b3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.490092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10085e-69dc-4139-966e-0197ca3b3bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.490773 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10085e-69dc-4139-966e-0197ca3b3bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.492726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10085e-69dc-4139-966e-0197ca3b3bc1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.511010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1288/2578] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:45 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:45.515054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb76de-deaa-48e0-bc50-ce30421c39fc admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.525192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb76de-deaa-48e0-bc50-ce30421c39fc admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.530355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c37f-51b0-4238-918a-68105c7972e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.531006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c37f-51b0-4238-918a-68105c7972e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.531285 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c37f-51b0-4238-918a-68105c7972e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.531585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c37f-51b0-4238-918a-68105c7972e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.532302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677c37f-51b0-4238-918a-68105c7972e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.533890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677c37f-51b0-4238-918a-68105c7972e8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.544565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1291/2579] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:45.548354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10085e-69dc-4139-966e-0197ca3b3bc1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.558130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10085e-69dc-4139-966e-0197ca3b3bc1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.562704 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb1c86-ca3f-4c7c-88a8-f8a0274c6d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.563380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb1c86-ca3f-4c7c-88a8-f8a0274c6d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.563659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb1c86-ca3f-4c7c-88a8-f8a0274c6d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.563930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb1c86-ca3f-4c7c-88a8-f8a0274c6d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.564644 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb1c86-ca3f-4c7c-88a8-f8a0274c6d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.566390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb1c86-ca3f-4c7c-88a8-f8a0274c6d59 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.581942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1289/2580] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:45.583124 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c37f-51b0-4238-918a-68105c7972e8 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.593592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c37f-51b0-4238-918a-68105c7972e8 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.598358 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec18401-6e78-4741-a015-29f8ce881308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.599219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18401-6e78-4741-a015-29f8ce881308 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.599621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18401-6e78-4741-a015-29f8ce881308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.599920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18401-6e78-4741-a015-29f8ce881308 admin admin] PATH_INFO: `/v3/projects/26231995dd444680a3d9ae9832472edb/users/5acdc0d0cb9f4f3a82ef2a36e9fab2bf/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.614598 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec18401-6e78-4741-a015-29f8ce881308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26231995dd444680a3d9ae9832472edb, user_id=5acdc0d0cb9f4f3a82ef2a36e9fab2bf, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.617283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec18401-6e78-4741-a015-29f8ce881308 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.630136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1292/2581] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:45 2022] PUT /identity/v3/projects/26231995dd444680a3d9ae9832472edb/users/5acdc0d0cb9f4f3a82ef2a36e9fab2bf/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:05:45.641121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31cb2-b461-4148-b415-61c0d5bfd533 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.641345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31cb2-b461-4148-b415-61c0d5bfd533 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.641663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31cb2-b461-4148-b415-61c0d5bfd533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.671904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-83d31cb2-b461-4148-b415-61c0d5bfd533 None None] MFA Rules not processed for user `5acdc0d0cb9f4f3a82ef2a36e9fab2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:45.673125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-83d31cb2-b461-4148-b415-61c0d5bfd533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:45.734228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1290/2582] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:45.738665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec18401-6e78-4741-a015-29f8ce881308 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.797571 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec18401-6e78-4741-a015-29f8ce881308 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.802181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3436f-10fe-406a-b7bc-6550f9dfc0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.802822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3436f-10fe-406a-b7bc-6550f9dfc0cd admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.803097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3436f-10fe-406a-b7bc-6550f9dfc0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.803401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3436f-10fe-406a-b7bc-6550f9dfc0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.804068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3436f-10fe-406a-b7bc-6550f9dfc0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.805961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3436f-10fe-406a-b7bc-6550f9dfc0cd admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.830250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1293/2583] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:45 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:45.834348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31cb2-b461-4148-b415-61c0d5bfd533 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.845576 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31cb2-b461-4148-b415-61c0d5bfd533 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.900026 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf59d-9294-48ab-9975-f1f52fbd306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.900609 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf59d-9294-48ab-9975-f1f52fbd306a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.900889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf59d-9294-48ab-9975-f1f52fbd306a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.901160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf59d-9294-48ab-9975-f1f52fbd306a admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.901830 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbf59d-9294-48ab-9975-f1f52fbd306a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.904484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbf59d-9294-48ab-9975-f1f52fbd306a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.923048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1291/2584] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:45 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:45.927066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3436f-10fe-406a-b7bc-6550f9dfc0cd admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.937247 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3436f-10fe-406a-b7bc-6550f9dfc0cd admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.941915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb48d57-b619-4932-a70f-876f6bf9d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.942567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48d57-b619-4932-a70f-876f6bf9d5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.942873 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48d57-b619-4932-a70f-876f6bf9d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.943167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48d57-b619-4932-a70f-876f6bf9d5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.944172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb48d57-b619-4932-a70f-876f6bf9d5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.945785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb48d57-b619-4932-a70f-876f6bf9d5fd admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:45.956511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1294/2585] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:45.960408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf59d-9294-48ab-9975-f1f52fbd306a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:45.971412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf59d-9294-48ab-9975-f1f52fbd306a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:45.976042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7d3-7281-46d5-a0d4-1258bd114a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:45.976920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7d3-7281-46d5-a0d4-1258bd114a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:45.977198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7d3-7281-46d5-a0d4-1258bd114a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:45.977474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7d3-7281-46d5-a0d4-1258bd114a7b admin admin] PATH_INFO: `/v3/projects/d87b1ed1412b454f92c395f131ef165d/users/231b816fcd264a41a432099e509d042a/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:45.991708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f7d3-7281-46d5-a0d4-1258bd114a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87b1ed1412b454f92c395f131ef165d, user_id=231b816fcd264a41a432099e509d042a, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:45.994336 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f7d3-7281-46d5-a0d4-1258bd114a7b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:46.007201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1292/2586] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:45 2022] PUT /identity/v3/projects/d87b1ed1412b454f92c395f131ef165d/users/231b816fcd264a41a432099e509d042a/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:46.011199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb48d57-b619-4932-a70f-876f6bf9d5fd admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:46.021412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb48d57-b619-4932-a70f-876f6bf9d5fd admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:46.076711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754f137-6140-45e6-82d1-5c399e7d4a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:46.077442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f137-6140-45e6-82d1-5c399e7d4a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:46.077802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f137-6140-45e6-82d1-5c399e7d4a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:46.078259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f137-6140-45e6-82d1-5c399e7d4a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:46.079181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754f137-6140-45e6-82d1-5c399e7d4a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:46.080804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754f137-6140-45e6-82d1-5c399e7d4a9c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:46.090312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1295/2587] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:46.094600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7d3-7281-46d5-a0d4-1258bd114a7b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:46.104606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7d3-7281-46d5-a0d4-1258bd114a7b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:46.109416 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:46.110299 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:46.110579 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:46.110855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] PATH_INFO: `/v3/projects/d87b1ed1412b454f92c395f131ef165d/users/231b816fcd264a41a432099e509d042a/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:46.112947 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87b1ed1412b454f92c395f131ef165d, user_id=231b816fcd264a41a432099e509d042a, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:46.115649 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:46.126257 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1293/2588] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:46 2022] PUT /identity/v3/projects/d87b1ed1412b454f92c395f131ef165d/users/231b816fcd264a41a432099e509d042a/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:05:46.136068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f055e51-d849-4562-94ac-18528a003d5f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:46.136351 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f055e51-d849-4562-94ac-18528a003d5f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:46.136622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f055e51-d849-4562-94ac-18528a003d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:46.162375 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-1f055e51-d849-4562-94ac-18528a003d5f None None] MFA Rules not processed for user `231b816fcd264a41a432099e509d042a`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:46.163589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1f055e51-d849-4562-94ac-18528a003d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:46.228820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1296/2589] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:46.240195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:46.241904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:46.298183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b3b2a-4eca-46f7-b666-75b203308017 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:46.301878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:46.302518 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:46.302806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:46.303078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:46.312776 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:46.314215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:46.324064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1294/2590] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:46.406613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f055e51-d849-4562-94ac-18528a003d5f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:46.416082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f055e51-d849-4562-94ac-18528a003d5f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:46.420173 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:46.420862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:46.421146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:46.421419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:46.475574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:46.477014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:46.486555 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1297/2591] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:47.950045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:47.956430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:48.027384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd517c1d-3c97-4f24-bb4c-6f4e4e0c5936 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:48.040712 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '911d21a666844fc399286e24c2892184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:48.041359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:48.041635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:48.041904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:48.044342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:48.056057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:48.057619 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:48.068188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1295/2592] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:48.762722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:48.764167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:48.836840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb23e52-2852-46ca-a001-8c0b39fe9fd3 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:48.841066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:48.841724 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:48.842003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:48.842271 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:48.844059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:48.909824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:48.911256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:48.920668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1298/2593] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:49.820290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:49.822511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:49.834787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4675f-dfb9-4b31-9a0e-fb7993e4d841 service placement] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:49.844677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:49.845738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:49.846791 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:49.847072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:49.849951 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:49.868422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:49.870092 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:49.883405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1296/2594] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:53.108628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:53.110328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:53.125326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3da33-0d67-42fc-b748-e49ac5af3ee4 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:53.130291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:53.131635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:53.132652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:53.133125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] PATH_INFO: `/v3/users/378aab35909343d88c0250493e41be34` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:53.134750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378aab35909343d88c0250493e41be34)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:53.136827 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:53.192334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378aab35909343d88c0250493e41be34'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.219520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378aab35909343d88c0250493e41be34'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.240169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378aab35909343d88c0250493e41be34'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.240899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378aab35909343d88c0250493e41be34'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.257478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-3ecf35f2-5373-47f8-8e52-d368bac31ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378aab35909343d88c0250493e41be34'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.267759 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1299/2595] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:53 2022] DELETE /identity/v3/users/378aab35909343d88c0250493e41be34 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:53.517742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:53.529663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfa7a1-fa6e-49ca-ac73-43a923c4a5d0 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:53.591531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:53.592395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:53.592675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:53.592948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] PATH_INFO: `/v3/projects/9e2d6a4c01b04940b13d9f1ca40bd778` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:53.594130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2d6a4c01b04940b13d9f1ca40bd778)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:53.596130 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:53.641940 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2d6a4c01b04940b13d9f1ca40bd778', 'request_id': 'req-2455fdc4-0146-4712-99e2-f806e01f4a73'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.647332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2d6a4c01b04940b13d9f1ca40bd778', 'request_id': 'req-2455fdc4-0146-4712-99e2-f806e01f4a73'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.656553 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2d6a4c01b04940b13d9f1ca40bd778', 'request_id': 'req-2455fdc4-0146-4712-99e2-f806e01f4a73'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.668825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] The token cache is being invalidate because project 9e2d6a4c01b04940b13d9f1ca40bd778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:53.669121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.669738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-2455fdc4-0146-4712-99e2-f806e01f4a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:53.671410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1297/2596] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:53 2022] DELETE /identity/v3/projects/9e2d6a4c01b04940b13d9f1ca40bd778 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:53.676302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264dbdd-993a-4118-84d1-d484dfc5825c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:53.676594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264dbdd-993a-4118-84d1-d484dfc5825c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:53.676929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264dbdd-993a-4118-84d1-d484dfc5825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:53.695364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e264dbdd-993a-4118-84d1-d484dfc5825c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:53.696579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e264dbdd-993a-4118-84d1-d484dfc5825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:53.755255 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1300/2597] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:53.764052 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab90f-3a16-40d0-9009-146315670299 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:53.764339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab90f-3a16-40d0-9009-146315670299 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:53.764614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab90f-3a16-40d0-9009-146315670299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:53.790463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-432ab90f-3a16-40d0-9009-146315670299 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:53.792148 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-432ab90f-3a16-40d0-9009-146315670299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:53.801646 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1298/2598] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:53.806069 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264dbdd-993a-4118-84d1-d484dfc5825c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:53.824646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264dbdd-993a-4118-84d1-d484dfc5825c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:53.844638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:53.845420 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:53.845779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:53.846127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:53.846983 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:05:53.848057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:53.849861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:53.866800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1301/2599] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:05:53.873307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ab90f-3a16-40d0-9009-146315670299 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:53.883163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ab90f-3a16-40d0-9009-146315670299 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:53.888817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef34a03-97b5-4563-b499-b1a3f7915dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:53.889500 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef34a03-97b5-4563-b499-b1a3f7915dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:53.889935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef34a03-97b5-4563-b499-b1a3f7915dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:53.890212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef34a03-97b5-4563-b499-b1a3f7915dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:53.890968 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef34a03-97b5-4563-b499-b1a3f7915dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:53.893071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef34a03-97b5-4563-b499-b1a3f7915dd3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:53.924783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1299/2600] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:53 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:53.929720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:53.941421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e6f20-fdba-4ff5-8ee2-b7e005ed9e8b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.013282 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb61a-b442-4aa0-abad-49d4556454f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.013955 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb61a-b442-4aa0-abad-49d4556454f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.014241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb61a-b442-4aa0-abad-49d4556454f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.014515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb61a-b442-4aa0-abad-49d4556454f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.015230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fb61a-b442-4aa0-abad-49d4556454f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.017203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fb61a-b442-4aa0-abad-49d4556454f2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.037959 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1302/2601] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:53 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:54.042063 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef34a03-97b5-4563-b499-b1a3f7915dd3 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.052403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef34a03-97b5-4563-b499-b1a3f7915dd3 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.057072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbf006-6dd8-411d-8fe3-64e249405318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.057732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbf006-6dd8-411d-8fe3-64e249405318 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.058014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbf006-6dd8-411d-8fe3-64e249405318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.058290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbf006-6dd8-411d-8fe3-64e249405318 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.059043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbf006-6dd8-411d-8fe3-64e249405318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.060680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbf006-6dd8-411d-8fe3-64e249405318 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.071575 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1300/2602] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:54.076238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb61a-b442-4aa0-abad-49d4556454f2 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.086022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb61a-b442-4aa0-abad-49d4556454f2 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.091217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d4593-d654-4eb3-afbe-f48b75fcc1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.091961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4593-d654-4eb3-afbe-f48b75fcc1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.092246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4593-d654-4eb3-afbe-f48b75fcc1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.092522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4593-d654-4eb3-afbe-f48b75fcc1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.093245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d4593-d654-4eb3-afbe-f48b75fcc1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.094857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d4593-d654-4eb3-afbe-f48b75fcc1c3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.105500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1303/2603] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:54.109626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbf006-6dd8-411d-8fe3-64e249405318 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.119489 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbf006-6dd8-411d-8fe3-64e249405318 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.124103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6705-302d-441c-8477-043bdf6bd6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.124972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6705-302d-441c-8477-043bdf6bd6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.125254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6705-302d-441c-8477-043bdf6bd6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.125529 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6705-302d-441c-8477-043bdf6bd6e9 admin admin] PATH_INFO: `/v3/projects/b748d127eb044fae931f919dc0081d12/users/8df089cf91274c6596a4a7f2d351a39f/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.140686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd6705-302d-441c-8477-043bdf6bd6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b748d127eb044fae931f919dc0081d12, user_id=8df089cf91274c6596a4a7f2d351a39f, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.143422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd6705-302d-441c-8477-043bdf6bd6e9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.157408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1301/2604] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:54 2022] PUT /identity/v3/projects/b748d127eb044fae931f919dc0081d12/users/8df089cf91274c6596a4a7f2d351a39f/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:54.167543 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf0715-4317-4830-bff8-5671182b1aaf None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.168053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf0715-4317-4830-bff8-5671182b1aaf None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.168355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf0715-4317-4830-bff8-5671182b1aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.203642 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d0bf0715-4317-4830-bff8-5671182b1aaf None None] MFA Rules not processed for user `8df089cf91274c6596a4a7f2d351a39f`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:54.204904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d0bf0715-4317-4830-bff8-5671182b1aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:54.302957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6705-302d-441c-8477-043bdf6bd6e9 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.304695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1304/2605] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:05:54.394767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6705-302d-441c-8477-043bdf6bd6e9 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.399730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ffa73-9f19-48c6-9780-685e04d7143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.400574 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ffa73-9f19-48c6-9780-685e04d7143d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.401058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ffa73-9f19-48c6-9780-685e04d7143d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.401327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ffa73-9f19-48c6-9780-685e04d7143d admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.402035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ffa73-9f19-48c6-9780-685e04d7143d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.404397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ffa73-9f19-48c6-9780-685e04d7143d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.439723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf0715-4317-4830-bff8-5671182b1aaf None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.450112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1302/2606] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:54 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:05:54.452723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf0715-4317-4830-bff8-5671182b1aaf None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.520644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379886f-b4a1-4a3b-b704-b9465ddffdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.521399 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379886f-b4a1-4a3b-b704-b9465ddffdcc admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.521748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379886f-b4a1-4a3b-b704-b9465ddffdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.522089 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379886f-b4a1-4a3b-b704-b9465ddffdcc admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.522877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379886f-b4a1-4a3b-b704-b9465ddffdcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.525149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379886f-b4a1-4a3b-b704-b9465ddffdcc admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.550874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1305/2607] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:54 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:05:54.552508 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ffa73-9f19-48c6-9780-685e04d7143d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.564234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ffa73-9f19-48c6-9780-685e04d7143d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.569886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81f24b-76ce-4b84-bb4f-ca10e200373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.570991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81f24b-76ce-4b84-bb4f-ca10e200373d admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.571461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81f24b-76ce-4b84-bb4f-ca10e200373d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.571887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81f24b-76ce-4b84-bb4f-ca10e200373d admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.572798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81f24b-76ce-4b84-bb4f-ca10e200373d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.575588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81f24b-76ce-4b84-bb4f-ca10e200373d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.592733 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1303/2608] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:05:54.594588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379886f-b4a1-4a3b-b704-b9465ddffdcc admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.605145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379886f-b4a1-4a3b-b704-b9465ddffdcc admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.610530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1d0d-daa2-4d8b-a327-dea9494ce9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.611480 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1d0d-daa2-4d8b-a327-dea9494ce9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.611764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1d0d-daa2-4d8b-a327-dea9494ce9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.612049 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1d0d-daa2-4d8b-a327-dea9494ce9fd admin admin] PATH_INFO: `/v3/projects/297e217b9df946de84cef6b9178acd80/users/c0de8fdc4ac2491397781c983cf81090/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.629171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f1d0d-daa2-4d8b-a327-dea9494ce9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=297e217b9df946de84cef6b9178acd80, user_id=c0de8fdc4ac2491397781c983cf81090, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.631893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f1d0d-daa2-4d8b-a327-dea9494ce9fd admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.647936 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1306/2609] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:54 2022] PUT /identity/v3/projects/297e217b9df946de84cef6b9178acd80/users/c0de8fdc4ac2491397781c983cf81090/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:54.651624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81f24b-76ce-4b84-bb4f-ca10e200373d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.663653 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81f24b-76ce-4b84-bb4f-ca10e200373d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.726211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d708d75-3e44-43d2-a5f9-5f039549b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.726891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d708d75-3e44-43d2-a5f9-5f039549b7ed admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.727195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d708d75-3e44-43d2-a5f9-5f039549b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.727496 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d708d75-3e44-43d2-a5f9-5f039549b7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.728220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d708d75-3e44-43d2-a5f9-5f039549b7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.732702 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d708d75-3e44-43d2-a5f9-5f039549b7ed admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.742708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1304/2610] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:54.746107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1d0d-daa2-4d8b-a327-dea9494ce9fd admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.760722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1d0d-daa2-4d8b-a327-dea9494ce9fd admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.768945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.769904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.770190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.770465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] PATH_INFO: `/v3/projects/297e217b9df946de84cef6b9178acd80/users/c0de8fdc4ac2491397781c983cf81090/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.772600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297e217b9df946de84cef6b9178acd80, user_id=c0de8fdc4ac2491397781c983cf81090, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:54.775523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:54.786696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1307/2611] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:54 2022] PUT /identity/v3/projects/297e217b9df946de84cef6b9178acd80/users/c0de8fdc4ac2491397781c983cf81090/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:54.797573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05f69-d491-4e96-8015-cf2a55a04ed1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.797857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05f69-d491-4e96-8015-cf2a55a04ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.798133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05f69-d491-4e96-8015-cf2a55a04ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:54.829730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-6ec05f69-d491-4e96-8015-cf2a55a04ed1 None None] MFA Rules not processed for user `c0de8fdc4ac2491397781c983cf81090`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:54.830972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6ec05f69-d491-4e96-8015-cf2a55a04ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:54.908846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1305/2612] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:54.920405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:54.922145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:54.977877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd394-2ca7-4fd5-9c28-f0bc304d7a10 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:54.982182 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6de8b1-a6dc-4291-9083-e94f7c4c04b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:54.982839 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6de8b1-a6dc-4291-9083-e94f7c4c04b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:54.983116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6de8b1-a6dc-4291-9083-e94f7c4c04b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:54.983434 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6de8b1-a6dc-4291-9083-e94f7c4c04b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:55.038723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6de8b1-a6dc-4291-9083-e94f7c4c04b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:55.040221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6de8b1-a6dc-4291-9083-e94f7c4c04b3 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:55.049826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1308/2613] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:57.879586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05f69-d491-4e96-8015-cf2a55a04ed1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:57.892192 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6ec05f69-d491-4e96-8015-cf2a55a04ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:57.961133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05f69-d491-4e96-8015-cf2a55a04ed1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:57.966503 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:57.967632 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:57.968089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:57.968319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] PATH_INFO: `/v3/users/5acdc0d0cb9f4f3a82ef2a36e9fab2bf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:57.969525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5acdc0d0cb9f4f3a82ef2a36e9fab2bf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:57.971482 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:58.028951 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5acdc0d0cb9f4f3a82ef2a36e9fab2bf'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.037948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5acdc0d0cb9f4f3a82ef2a36e9fab2bf'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.038895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5acdc0d0cb9f4f3a82ef2a36e9fab2bf'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.058331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5acdc0d0cb9f4f3a82ef2a36e9fab2bf'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.059539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5acdc0d0cb9f4f3a82ef2a36e9fab2bf'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.081775 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1306/2614] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:57 2022] DELETE /identity/v3/users/5acdc0d0cb9f4f3a82ef2a36e9fab2bf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:58.086245 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24db08-c75e-4fdc-a4a4-8eb10fa78a7c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:58.087246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24db08-c75e-4fdc-a4a4-8eb10fa78a7c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:58.091503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24db08-c75e-4fdc-a4a4-8eb10fa78a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:58.122207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9f24db08-c75e-4fdc-a4a4-8eb10fa78a7c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:58.125577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9f24db08-c75e-4fdc-a4a4-8eb10fa78a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:58.127402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:58.129691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:58.195167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1309/2615] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:05:58.216197 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24db08-c75e-4fdc-a4a4-8eb10fa78a7c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:58.218241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9f24db08-c75e-4fdc-a4a4-8eb10fa78a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:58.229674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df33a90-ff12-4825-ac46-d2abee12a7a7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:58.235201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:58.236099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:58.236383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:58.236654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] PATH_INFO: `/v3/users/521ce300deaf4ebba282688e5b8fa394` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:58.237906 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521ce300deaf4ebba282688e5b8fa394)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:58.239878 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:58.280323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24db08-c75e-4fdc-a4a4-8eb10fa78a7c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:58.284092 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856d61b-4a73-45f6-a9ca-caf9ebac1294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:58.284740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856d61b-4a73-45f6-a9ca-caf9ebac1294 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:58.285026 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856d61b-4a73-45f6-a9ca-caf9ebac1294 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:58.285302 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856d61b-4a73-45f6-a9ca-caf9ebac1294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:58.295167 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856d61b-4a73-45f6-a9ca-caf9ebac1294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:58.295873 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521ce300deaf4ebba282688e5b8fa394'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.296644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856d61b-4a73-45f6-a9ca-caf9ebac1294 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:58.302588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521ce300deaf4ebba282688e5b8fa394'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.303260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521ce300deaf4ebba282688e5b8fa394'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.306117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1310/2616] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:05:58.310625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521ce300deaf4ebba282688e5b8fa394'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.311244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521ce300deaf4ebba282688e5b8fa394'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.328354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1307/2617] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:58 2022] DELETE /identity/v3/users/521ce300deaf4ebba282688e5b8fa394 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:58.509171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856d61b-4a73-45f6-a9ca-caf9ebac1294 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:58.519792 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856d61b-4a73-45f6-a9ca-caf9ebac1294 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:58.581077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:58.582154 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:58.582473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:58.582811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] PATH_INFO: `/v3/projects/7d1d877d09894265a3ecb65f70684a29` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:58.584270 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1d877d09894265a3ecb65f70684a29)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:58.588870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:58.590973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:58.592515 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:58.606642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1555b5-0998-403d-9d56-d8e5100d6de6 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:58.611779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:58.612861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:58.613326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:58.613600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] PATH_INFO: `/v3/projects/26231995dd444680a3d9ae9832472edb` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:58.614787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26231995dd444680a3d9ae9832472edb)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:58.616730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:58.641821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1d877d09894265a3ecb65f70684a29', 'request_id': 'req-5a37528e-c343-4cdf-a3bc-37268a217994'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.648760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1d877d09894265a3ecb65f70684a29', 'request_id': 'req-5a37528e-c343-4cdf-a3bc-37268a217994'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.655192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1d877d09894265a3ecb65f70684a29', 'request_id': 'req-5a37528e-c343-4cdf-a3bc-37268a217994'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.664118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26231995dd444680a3d9ae9832472edb', 'request_id': 'req-0a5930e1-121c-415d-a3f8-4cadf565215e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.666225 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] The token cache is being invalidate because project 7d1d877d09894265a3ecb65f70684a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:58.666508 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.667139 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.668737 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1311/2618] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:58 2022] DELETE /identity/v3/projects/7d1d877d09894265a3ecb65f70684a29 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:58.669667 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26231995dd444680a3d9ae9832472edb', 'request_id': 'req-0a5930e1-121c-415d-a3f8-4cadf565215e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.672726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:58.675240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:58.678248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26231995dd444680a3d9ae9832472edb', 'request_id': 'req-0a5930e1-121c-415d-a3f8-4cadf565215e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.690284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] The token cache is being invalidate because project 26231995dd444680a3d9ae9832472edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:58.690626 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.691280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.696153 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1308/2619] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:58 2022] DELETE /identity/v3/projects/26231995dd444680a3d9ae9832472edb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:58.696948 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:58.698317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:58.739484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37528e-c343-4cdf-a3bc-37268a217994 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:58.765126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5930e1-121c-415d-a3f8-4cadf565215e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:58.769783 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:58.770652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:58.770927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:58.771188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] PATH_INFO: `/v3/users/231b816fcd264a41a432099e509d042a` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:58.772388 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=231b816fcd264a41a432099e509d042a)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:58.774369 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:58.799930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:58.801098 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:58.801546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:58.801868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] PATH_INFO: `/v3/users/adfe6c1c0fae4e90a76377c4776711b0` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:58.803177 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfe6c1c0fae4e90a76377c4776711b0)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:58.805301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:58.823935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231b816fcd264a41a432099e509d042a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.831884 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231b816fcd264a41a432099e509d042a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.832606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231b816fcd264a41a432099e509d042a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.840490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231b816fcd264a41a432099e509d042a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.841265 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231b816fcd264a41a432099e509d042a'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.860290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1309/2620] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:58 2022] DELETE /identity/v3/users/231b816fcd264a41a432099e509d042a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:05:58.864727 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfe6c1c0fae4e90a76377c4776711b0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.872944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfe6c1c0fae4e90a76377c4776711b0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.881573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfe6c1c0fae4e90a76377c4776711b0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.882226 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfe6c1c0fae4e90a76377c4776711b0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.895632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfe6c1c0fae4e90a76377c4776711b0'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:58.902627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1312/2621] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:05:58 2022] DELETE /identity/v3/users/adfe6c1c0fae4e90a76377c4776711b0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:59.080698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.082346 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:59.142637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.144240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:59.162329 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8683e7f-3f7b-45b2-abc2-62dbbe4ff95d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.220298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019109-bd0f-4440-9206-4fc19b4f7e54 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.221601 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.222469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.222750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.223023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] PATH_INFO: `/v3/projects/7208709de9ce4cfd9176966e1b5a4428` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.224236 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7208709de9ce4cfd9176966e1b5a4428)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.224917 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.225847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.226129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.226225 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.226401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] PATH_INFO: `/v3/projects/d87b1ed1412b454f92c395f131ef165d` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.227609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87b1ed1412b454f92c395f131ef165d)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.229502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.273226 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7208709de9ce4cfd9176966e1b5a4428', 'request_id': 'req-8b7c7988-cdfa-4577-a97d-a32707661c4d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.275256 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87b1ed1412b454f92c395f131ef165d', 'request_id': 'req-dbeed9cd-d173-4475-a0f7-81463ce3e66d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.279530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7208709de9ce4cfd9176966e1b5a4428', 'request_id': 'req-8b7c7988-cdfa-4577-a97d-a32707661c4d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.284572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87b1ed1412b454f92c395f131ef165d', 'request_id': 'req-dbeed9cd-d173-4475-a0f7-81463ce3e66d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.287971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7208709de9ce4cfd9176966e1b5a4428', 'request_id': 'req-8b7c7988-cdfa-4577-a97d-a32707661c4d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.290762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87b1ed1412b454f92c395f131ef165d', 'request_id': 'req-dbeed9cd-d173-4475-a0f7-81463ce3e66d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.300643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] The token cache is being invalidate because project 7208709de9ce4cfd9176966e1b5a4428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:59.300933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.301571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8b7c7988-cdfa-4577-a97d-a32707661c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.303343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1310/2622] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:59 2022] DELETE /identity/v3/projects/7208709de9ce4cfd9176966e1b5a4428 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:05:59.303890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] The token cache is being invalidate because project d87b1ed1412b454f92c395f131ef165d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:05:59.304181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.304853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dbeed9cd-d173-4475-a0f7-81463ce3e66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:05:59.310250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1313/2623] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:05:59 2022] DELETE /identity/v3/projects/d87b1ed1412b454f92c395f131ef165d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:59.313112 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df97c-dbb8-46e4-bcb1-c17bc215cacf None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.313481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df97c-dbb8-46e4-bcb1-c17bc215cacf None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.313755 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df97c-dbb8-46e4-bcb1-c17bc215cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.334933 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-138df97c-dbb8-46e4-bcb1-c17bc215cacf None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:59.336202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-138df97c-dbb8-46e4-bcb1-c17bc215cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:59.398323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1311/2624] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:59.406463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81330-35f8-4b2f-9a70-66160604b624 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.406750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81330-35f8-4b2f-9a70-66160604b624 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.407084 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81330-35f8-4b2f-9a70-66160604b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.427328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-49d81330-35f8-4b2f-9a70-66160604b624 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:59.428592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-49d81330-35f8-4b2f-9a70-66160604b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:59.437356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1314/2625] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:59.441797 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df97c-dbb8-46e4-bcb1-c17bc215cacf None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.452403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df97c-dbb8-46e4-bcb1-c17bc215cacf None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.457276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.457963 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.458233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.458509 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.459273 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:05:59.459612 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.461244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.478441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1312/2626] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:05:59.479629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81330-35f8-4b2f-9a70-66160604b624 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.489818 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81330-35f8-4b2f-9a70-66160604b624 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.494869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704c63a-aedf-4b99-9b57-e18cf140ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.495578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704c63a-aedf-4b99-9b57-e18cf140ded8 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.495860 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704c63a-aedf-4b99-9b57-e18cf140ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.496790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704c63a-aedf-4b99-9b57-e18cf140ded8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.497506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704c63a-aedf-4b99-9b57-e18cf140ded8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.499458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704c63a-aedf-4b99-9b57-e18cf140ded8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.530680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1315/2627] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:59 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:05:59.532053 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.542531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe35a41-9817-45d0-be49-f90a515e1fe4 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.600069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9c6df-f25f-4d66-b53b-097ba627395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.600782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9c6df-f25f-4d66-b53b-097ba627395d admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.601071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9c6df-f25f-4d66-b53b-097ba627395d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.601341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9c6df-f25f-4d66-b53b-097ba627395d admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.602023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9c6df-f25f-4d66-b53b-097ba627395d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.604088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9c6df-f25f-4d66-b53b-097ba627395d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.623795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1313/2628] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:59 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:59.628126 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704c63a-aedf-4b99-9b57-e18cf140ded8 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.638205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704c63a-aedf-4b99-9b57-e18cf140ded8 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.642850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e8b0-4c7e-456c-825f-036f9ddd1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.643533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e8b0-4c7e-456c-825f-036f9ddd1b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.643819 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e8b0-4c7e-456c-825f-036f9ddd1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.644094 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e8b0-4c7e-456c-825f-036f9ddd1b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.644845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876e8b0-4c7e-456c-825f-036f9ddd1b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.646443 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876e8b0-4c7e-456c-825f-036f9ddd1b13 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.657074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1316/2629] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:59.660758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9c6df-f25f-4d66-b53b-097ba627395d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.671168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9c6df-f25f-4d66-b53b-097ba627395d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.675807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074a34f-46f4-4702-bd0f-e3e8f83cfd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.676455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074a34f-46f4-4702-bd0f-e3e8f83cfd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.676736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074a34f-46f4-4702-bd0f-e3e8f83cfd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.677010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074a34f-46f4-4702-bd0f-e3e8f83cfd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.677729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074a34f-46f4-4702-bd0f-e3e8f83cfd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.679436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074a34f-46f4-4702-bd0f-e3e8f83cfd53 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.689078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1314/2630] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:05:59.693028 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e8b0-4c7e-456c-825f-036f9ddd1b13 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.703657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e8b0-4c7e-456c-825f-036f9ddd1b13 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.708385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991cb4e-ab9f-47f5-949a-ac984c1f9c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.709291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991cb4e-ab9f-47f5-949a-ac984c1f9c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.709560 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991cb4e-ab9f-47f5-949a-ac984c1f9c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.709837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991cb4e-ab9f-47f5-949a-ac984c1f9c79 admin admin] PATH_INFO: `/v3/projects/dc41c9839d484c3c8566002f3f176806/users/d2d9574819394e9499ca1381725e74ce/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.724976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991cb4e-ab9f-47f5-949a-ac984c1f9c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc41c9839d484c3c8566002f3f176806, user_id=d2d9574819394e9499ca1381725e74ce, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.727653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991cb4e-ab9f-47f5-949a-ac984c1f9c79 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.741068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1317/2631] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:05:59 2022] PUT /identity/v3/projects/dc41c9839d484c3c8566002f3f176806/users/d2d9574819394e9499ca1381725e74ce/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:05:59.751043 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f936b-60be-42ee-968d-db6d13ff8e45 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.751384 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f936b-60be-42ee-968d-db6d13ff8e45 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.751661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f936b-60be-42ee-968d-db6d13ff8e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.777820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-007f936b-60be-42ee-968d-db6d13ff8e45 None None] MFA Rules not processed for user `d2d9574819394e9499ca1381725e74ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:05:59.779028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-007f936b-60be-42ee-968d-db6d13ff8e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:05:59.840966 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1315/2632] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:05:59.845436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991cb4e-ab9f-47f5-949a-ac984c1f9c79 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.905610 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991cb4e-ab9f-47f5-949a-ac984c1f9c79 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:05:59.910127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c5ce-1cd4-4c45-8c05-d1777662bc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:05:59.910778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c5ce-1cd4-4c45-8c05-d1777662bc2f admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:05:59.911059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c5ce-1cd4-4c45-8c05-d1777662bc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:05:59.911361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44c5ce-1cd4-4c45-8c05-d1777662bc2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:05:59.912039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44c5ce-1cd4-4c45-8c05-d1777662bc2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:05:59.913932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44c5ce-1cd4-4c45-8c05-d1777662bc2f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:05:59.938515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1318/2633] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:05:59 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:05:59.942488 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f936b-60be-42ee-968d-db6d13ff8e45 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:05:59.953876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f936b-60be-42ee-968d-db6d13ff8e45 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:00.008354 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671479e-5564-4de2-b791-c3fb99628943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:00.009015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671479e-5564-4de2-b791-c3fb99628943 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:00.009298 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671479e-5564-4de2-b791-c3fb99628943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:00.009570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671479e-5564-4de2-b791-c3fb99628943 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:00.010259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671479e-5564-4de2-b791-c3fb99628943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:00.012729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671479e-5564-4de2-b791-c3fb99628943 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:00.032177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1316/2634] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:05:59 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:00.036291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c5ce-1cd4-4c45-8c05-d1777662bc2f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:00.046466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44c5ce-1cd4-4c45-8c05-d1777662bc2f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:00.051066 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce1e4-ffc3-487e-9a26-51e4848df51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:00.051752 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce1e4-ffc3-487e-9a26-51e4848df51d admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:00.052036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce1e4-ffc3-487e-9a26-51e4848df51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:00.052338 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce1e4-ffc3-487e-9a26-51e4848df51d admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:00.053054 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ce1e4-ffc3-487e-9a26-51e4848df51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:00.054643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ce1e4-ffc3-487e-9a26-51e4848df51d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:00.064916 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1319/2635] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:00.069110 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671479e-5564-4de2-b791-c3fb99628943 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:00.079399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671479e-5564-4de2-b791-c3fb99628943 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:00.084000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bda37d-3a01-46a8-b3f1-8562487a9720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:00.084864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda37d-3a01-46a8-b3f1-8562487a9720 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:00.085144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda37d-3a01-46a8-b3f1-8562487a9720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:00.085418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda37d-3a01-46a8-b3f1-8562487a9720 admin admin] PATH_INFO: `/v3/projects/8654afbfad4844c7a7743160607fcddd/users/20d83f9d927948f4a43f59f97b4debcb/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:00.100161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bda37d-3a01-46a8-b3f1-8562487a9720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8654afbfad4844c7a7743160607fcddd, user_id=20d83f9d927948f4a43f59f97b4debcb, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:00.102833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bda37d-3a01-46a8-b3f1-8562487a9720 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:00.115309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1317/2636] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:00 2022] PUT /identity/v3/projects/8654afbfad4844c7a7743160607fcddd/users/20d83f9d927948f4a43f59f97b4debcb/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:00.119093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce1e4-ffc3-487e-9a26-51e4848df51d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:00.128900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce1e4-ffc3-487e-9a26-51e4848df51d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:00.183872 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80242-92ed-4038-9cd9-7c5ecd38af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:00.184526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80242-92ed-4038-9cd9-7c5ecd38af90 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:00.184747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80242-92ed-4038-9cd9-7c5ecd38af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:00.185019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80242-92ed-4038-9cd9-7c5ecd38af90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:00.185734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a80242-92ed-4038-9cd9-7c5ecd38af90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:00.187499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a80242-92ed-4038-9cd9-7c5ecd38af90 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:00.197579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1320/2637] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:00.202136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bda37d-3a01-46a8-b3f1-8562487a9720 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:00.212411 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bda37d-3a01-46a8-b3f1-8562487a9720 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:00.218084 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:00.218981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:00.219262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:00.219566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] PATH_INFO: `/v3/projects/8654afbfad4844c7a7743160607fcddd/users/20d83f9d927948f4a43f59f97b4debcb/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:00.221533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8654afbfad4844c7a7743160607fcddd, user_id=20d83f9d927948f4a43f59f97b4debcb, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:00.224213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:00.234180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1318/2638] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:00 2022] PUT /identity/v3/projects/8654afbfad4844c7a7743160607fcddd/users/20d83f9d927948f4a43f59f97b4debcb/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:00.244116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78fb8d-1ed3-4b7d-8e75-f5ba5dace58a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:00.244405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78fb8d-1ed3-4b7d-8e75-f5ba5dace58a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:00.244681 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78fb8d-1ed3-4b7d-8e75-f5ba5dace58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:00.271653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-cc78fb8d-1ed3-4b7d-8e75-f5ba5dace58a None None] MFA Rules not processed for user `20d83f9d927948f4a43f59f97b4debcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:00.272854 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-cc78fb8d-1ed3-4b7d-8e75-f5ba5dace58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:00.345524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1321/2639] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:00.356157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:00.357862 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:00.413186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a57c-6bed-4887-a18b-cee60a3ea0b7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:00.416770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:00.417397 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:00.417675 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:00.417945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:00.426747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:00.428189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:00.437911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1319/2640] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:01.727915 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78fb8d-1ed3-4b7d-8e75-f5ba5dace58a None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:01.786300 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:01.788256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:01.795585 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78fb8d-1ed3-4b7d-8e75-f5ba5dace58a None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:01.800569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd788a-8216-44e2-a385-652fc2bac7eb service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:01.800768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:01.801799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:01.802029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:01.802359 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] PATH_INFO: `/v3/users/d2d9574819394e9499ca1381725e74ce` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:01.803710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d9574819394e9499ca1381725e74ce)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:01.805629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990976ba-1743-4980-a8cd-3bc2093f1ed5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:01.805794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:01.806618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990976ba-1743-4980-a8cd-3bc2093f1ed5 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:01.806992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990976ba-1743-4980-a8cd-3bc2093f1ed5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:01.807439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990976ba-1743-4980-a8cd-3bc2093f1ed5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:01.810097 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-990976ba-1743-4980-a8cd-3bc2093f1ed5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:01.857171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d9574819394e9499ca1381725e74ce'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:01.864654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d9574819394e9499ca1381725e74ce'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:01.873355 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d9574819394e9499ca1381725e74ce'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:01.874288 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d9574819394e9499ca1381725e74ce'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:01.878851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990976ba-1743-4980-a8cd-3bc2093f1ed5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:01.880380 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990976ba-1743-4980-a8cd-3bc2093f1ed5 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:01.887110 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d9574819394e9499ca1381725e74ce'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:01.891277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1320/2641] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:06:01.893776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1322/2642] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:01 2022] DELETE /identity/v3/users/d2d9574819394e9499ca1381725e74ce => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:01.898440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7addb0-5370-4c0f-a0ab-2455980ae5ca None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:01.898603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7addb0-5370-4c0f-a0ab-2455980ae5ca None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:01.898907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7addb0-5370-4c0f-a0ab-2455980ae5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:01.915811 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-bf7addb0-5370-4c0f-a0ab-2455980ae5ca None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:01.917035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bf7addb0-5370-4c0f-a0ab-2455980ae5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:01.978921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1321/2643] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:01.987562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:01.988988 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:02.046687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4542cd-e170-4636-bf28-7547c4b17a89 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:02.050321 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6341a23-6bd6-42ff-aedd-79575763741a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:02.050976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6341a23-6bd6-42ff-aedd-79575763741a service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:02.051419 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6341a23-6bd6-42ff-aedd-79575763741a service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:02.051711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6341a23-6bd6-42ff-aedd-79575763741a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:02.062004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6341a23-6bd6-42ff-aedd-79575763741a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:02.063478 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6341a23-6bd6-42ff-aedd-79575763741a service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:02.073476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1323/2644] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:02.345412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7addb0-5370-4c0f-a0ab-2455980ae5ca None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:02.346882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bf7addb0-5370-4c0f-a0ab-2455980ae5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:02.360389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7addb0-5370-4c0f-a0ab-2455980ae5ca None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:02.365288 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:02.366217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:02.366498 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:02.366819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] PATH_INFO: `/v3/projects/dc41c9839d484c3c8566002f3f176806` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:02.373663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc41c9839d484c3c8566002f3f176806)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:02.375631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:02.420688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc41c9839d484c3c8566002f3f176806', 'request_id': 'req-7c79d81b-7f74-4770-b8d9-df0ab7863598'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.425894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc41c9839d484c3c8566002f3f176806', 'request_id': 'req-7c79d81b-7f74-4770-b8d9-df0ab7863598'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.432396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc41c9839d484c3c8566002f3f176806', 'request_id': 'req-7c79d81b-7f74-4770-b8d9-df0ab7863598'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.442934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] The token cache is being invalidate because project dc41c9839d484c3c8566002f3f176806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:02.443215 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.444109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.445615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1322/2645] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:02 2022] DELETE /identity/v3/projects/dc41c9839d484c3c8566002f3f176806 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:02.449565 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6341a23-6bd6-42ff-aedd-79575763741a service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:02.459664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6341a23-6bd6-42ff-aedd-79575763741a service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:02.515040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:02.515879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:02.516165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:02.516441 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] PATH_INFO: `/v3/users/20d83f9d927948f4a43f59f97b4debcb` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:02.517616 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d83f9d927948f4a43f59f97b4debcb)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:02.519590 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:02.562573 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d83f9d927948f4a43f59f97b4debcb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.569586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d83f9d927948f4a43f59f97b4debcb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.577471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d83f9d927948f4a43f59f97b4debcb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.578252 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d83f9d927948f4a43f59f97b4debcb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.592534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-4e529a89-41b1-40b1-b0d9-bdd9052f7398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d83f9d927948f4a43f59f97b4debcb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.598669 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1324/2646] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:02 2022] DELETE /identity/v3/users/20d83f9d927948f4a43f59f97b4debcb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:02.707046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:02.708534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:02.721252 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d81b-7f74-4770-b8d9-df0ab7863598 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:02.779851 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:02.780690 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:02.780977 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:02.781251 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] PATH_INFO: `/v3/users/0702a357415e4edbbb7a452fbdf4260c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:02.782730 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0702a357415e4edbbb7a452fbdf4260c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:02.784802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:02.833539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0702a357415e4edbbb7a452fbdf4260c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.840234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0702a357415e4edbbb7a452fbdf4260c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.840921 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0702a357415e4edbbb7a452fbdf4260c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.848310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0702a357415e4edbbb7a452fbdf4260c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.848937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0702a357415e4edbbb7a452fbdf4260c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:02.869409 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1323/2647] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:02 2022] DELETE /identity/v3/users/0702a357415e4edbbb7a452fbdf4260c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:02.875842 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c446-54d3-4361-b907-211adf92baf1 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:02.876494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c446-54d3-4361-b907-211adf92baf1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:02.876494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c446-54d3-4361-b907-211adf92baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:02.883253 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:02.885596 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:02.904442 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e058c446-54d3-4361-b907-211adf92baf1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:02.906527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e058c446-54d3-4361-b907-211adf92baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:02.964393 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198c2c7-a044-40f5-b2b9-997ba1b71af2 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:02.969014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:02.969866 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:02.970139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:02.970408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] PATH_INFO: `/v3/projects/8654afbfad4844c7a7743160607fcddd` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:02.971578 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8654afbfad4844c7a7743160607fcddd)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:02.972090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1325/2648] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:02.973624 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:02.982227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c446-54d3-4361-b907-211adf92baf1 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:02.983630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e058c446-54d3-4361-b907-211adf92baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.019511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8654afbfad4844c7a7743160607fcddd', 'request_id': 'req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.024762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8654afbfad4844c7a7743160607fcddd', 'request_id': 'req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.033046 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8654afbfad4844c7a7743160607fcddd', 'request_id': 'req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.039106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c446-54d3-4361-b907-211adf92baf1 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.044372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] The token cache is being invalidate because project 8654afbfad4844c7a7743160607fcddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:03.044656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.045361 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a5f82d37-667a-4b4f-89b1-2443a9ad5a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.046928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1324/2649] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:02 2022] DELETE /identity/v3/projects/8654afbfad4844c7a7743160607fcddd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:03.051549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc05d15-7d61-4626-8318-20410df3b549 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.051835 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc05d15-7d61-4626-8318-20410df3b549 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.052105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc05d15-7d61-4626-8318-20410df3b549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.070326 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-9bc05d15-7d61-4626-8318-20410df3b549 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:03.071558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9bc05d15-7d61-4626-8318-20410df3b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.087152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.087834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.088116 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.088388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.090191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.129652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1325/2650] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:03.138385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b29dc-3d6d-41fc-8936-3ee8238ef4e0 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.138677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b29dc-3d6d-41fc-8936-3ee8238ef4e0 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.138954 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b29dc-3d6d-41fc-8936-3ee8238ef4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.153243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.154710 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.156095 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-2d4b29dc-3d6d-41fc-8936-3ee8238ef4e0 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:03.157271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2d4b29dc-3d6d-41fc-8936-3ee8238ef4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.164336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1326/2651] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:06:03.165229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1326/2652] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:03.169643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.178929 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ea0e5-37a6-4f1c-9d02-fcb2ca10230a service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.183934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.185157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.185521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.185698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.186473 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:03.186742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.188401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.200950 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1327/2653] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 19:06:03.205297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b29dc-3d6d-41fc-8936-3ee8238ef4e0 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.217275 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b29dc-3d6d-41fc-8936-3ee8238ef4e0 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.222809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89911e-0809-4f55-b2fc-2a964b8f2d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.223511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89911e-0809-4f55-b2fc-2a964b8f2d14 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.223789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89911e-0809-4f55-b2fc-2a964b8f2d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.224188 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89911e-0809-4f55-b2fc-2a964b8f2d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.224976 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89911e-0809-4f55-b2fc-2a964b8f2d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.227235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89911e-0809-4f55-b2fc-2a964b8f2d14 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.258725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1327/2654] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:03.260224 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.270971 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a3550-e082-424e-b7be-f66394eb4aaa admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.333082 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0c02-bd85-47e3-aacf-699f3a4ec633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.333871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0c02-bd85-47e3-aacf-699f3a4ec633 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.334153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0c02-bd85-47e3-aacf-699f3a4ec633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.334425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0c02-bd85-47e3-aacf-699f3a4ec633 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.335099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e0c02-bd85-47e3-aacf-699f3a4ec633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.337081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e0c02-bd85-47e3-aacf-699f3a4ec633 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.358741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1328/2655] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:03.362937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89911e-0809-4f55-b2fc-2a964b8f2d14 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.373142 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89911e-0809-4f55-b2fc-2a964b8f2d14 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.377680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbd5fc-6d9f-4c77-9920-1af4be271706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.378341 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbd5fc-6d9f-4c77-9920-1af4be271706 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.378621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbd5fc-6d9f-4c77-9920-1af4be271706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.378894 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbd5fc-6d9f-4c77-9920-1af4be271706 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.379656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbd5fc-6d9f-4c77-9920-1af4be271706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.381351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbd5fc-6d9f-4c77-9920-1af4be271706 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.391960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1328/2656] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:03.395962 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0c02-bd85-47e3-aacf-699f3a4ec633 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.406232 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0c02-bd85-47e3-aacf-699f3a4ec633 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.410852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.411534 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.411811 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.412113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.412891 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.414513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.424629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1329/2657] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:03.429325 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbd5fc-6d9f-4c77-9920-1af4be271706 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.438898 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.440378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbd5fc-6d9f-4c77-9920-1af4be271706 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.441392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.445728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3967c2-5bac-46e6-92bf-17c62f7942d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.446657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3967c2-5bac-46e6-92bf-17c62f7942d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.446989 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3967c2-5bac-46e6-92bf-17c62f7942d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.447367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3967c2-5bac-46e6-92bf-17c62f7942d0 admin admin] PATH_INFO: `/v3/projects/0a1293c92cd34bdabdd8b7b2f2260c61/users/b9e8eb67f16c4ff8b60b86604ee98a29/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.462904 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3967c2-5bac-46e6-92bf-17c62f7942d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1293c92cd34bdabdd8b7b2f2260c61, user_id=b9e8eb67f16c4ff8b60b86604ee98a29, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.463389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be519c1e-6f5d-4ff3-8b99-77fd18e40d67 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.465705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3967c2-5bac-46e6-92bf-17c62f7942d0 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.468371 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.469204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.469507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.469894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] PATH_INFO: `/v3/projects/00418919e0804082942d900d49cceb18` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.471094 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00418919e0804082942d900d49cceb18)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.473213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.478789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1329/2658] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:03 2022] PUT /identity/v3/projects/0a1293c92cd34bdabdd8b7b2f2260c61/users/b9e8eb67f16c4ff8b60b86604ee98a29/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:03.488781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbf828-b1cf-4a10-afd5-86f0d9a264a4 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.489141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbf828-b1cf-4a10-afd5-86f0d9a264a4 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.489487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbf828-b1cf-4a10-afd5-86f0d9a264a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.516001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-d6dbf828-b1cf-4a10-afd5-86f0d9a264a4 None None] MFA Rules not processed for user `b9e8eb67f16c4ff8b60b86604ee98a29`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:03.517284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d6dbf828-b1cf-4a10-afd5-86f0d9a264a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.525888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00418919e0804082942d900d49cceb18', 'request_id': 'req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.533506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00418919e0804082942d900d49cceb18', 'request_id': 'req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.539105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00418919e0804082942d900d49cceb18', 'request_id': 'req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.550400 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] The token cache is being invalidate because project 00418919e0804082942d900d49cceb18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:03.550804 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.551507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ae552de9-8ffd-4cca-ad8e-064a1c10b25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:03.553099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1330/2659] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:03 2022] DELETE /identity/v3/projects/00418919e0804082942d900d49cceb18 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:03.557797 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29747e-89d0-478c-bfc7-e738b7f82d0b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.558014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29747e-89d0-478c-bfc7-e738b7f82d0b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.558334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29747e-89d0-478c-bfc7-e738b7f82d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.576864 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5d29747e-89d0-478c-bfc7-e738b7f82d0b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:03.578168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5d29747e-89d0-478c-bfc7-e738b7f82d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.584228 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1330/2660] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:03.588637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbf828-b1cf-4a10-afd5-86f0d9a264a4 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.590002 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-d6dbf828-b1cf-4a10-afd5-86f0d9a264a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.635652 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1331/2661] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:03.644657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91fdb-a9e7-4ad4-bdba-d1de6d0bfa49 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.644940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91fdb-a9e7-4ad4-bdba-d1de6d0bfa49 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.645505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91fdb-a9e7-4ad4-bdba-d1de6d0bfa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.657889 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbf828-b1cf-4a10-afd5-86f0d9a264a4 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.662629 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27f9dd-6452-4453-9a2f-b274a91bf2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.663014 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8eb91fdb-a9e7-4ad4-bdba-d1de6d0bfa49 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:03.663290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f9dd-6452-4453-9a2f-b274a91bf2be admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.663600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f9dd-6452-4453-9a2f-b274a91bf2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.663875 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f9dd-6452-4453-9a2f-b274a91bf2be admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.664257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8eb91fdb-a9e7-4ad4-bdba-d1de6d0bfa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:03.664592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27f9dd-6452-4453-9a2f-b274a91bf2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.666493 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27f9dd-6452-4453-9a2f-b274a91bf2be admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.672531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1332/2662] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:03.676626 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb91fdb-a9e7-4ad4-bdba-d1de6d0bfa49 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.685832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb91fdb-a9e7-4ad4-bdba-d1de6d0bfa49 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.690453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.691090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.691402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.691674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.692381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:03.692683 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.693077 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1331/2663] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:03.694711 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.697104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27f9dd-6452-4453-9a2f-b274a91bf2be admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.709674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1333/2664] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 19:06:03.710689 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.720077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd4bd0-365d-42ce-89e2-8467d1c6c55c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.757420 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27f9dd-6452-4453-9a2f-b274a91bf2be admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.762045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911302d2-7cb2-4d10-9a88-3428f43d590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.762708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911302d2-7cb2-4d10-9a88-3428f43d590a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.762990 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911302d2-7cb2-4d10-9a88-3428f43d590a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.763276 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911302d2-7cb2-4d10-9a88-3428f43d590a admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.763984 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911302d2-7cb2-4d10-9a88-3428f43d590a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.765935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911302d2-7cb2-4d10-9a88-3428f43d590a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.775317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3c8fc-092c-4e3a-a510-c35ac9671ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.775982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c8fc-092c-4e3a-a510-c35ac9671ecc admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.776266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c8fc-092c-4e3a-a510-c35ac9671ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.776545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c8fc-092c-4e3a-a510-c35ac9671ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.777291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3c8fc-092c-4e3a-a510-c35ac9671ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.779183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3c8fc-092c-4e3a-a510-c35ac9671ecc admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.786839 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1332/2665] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:03.790536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911302d2-7cb2-4d10-9a88-3428f43d590a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.801058 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911302d2-7cb2-4d10-9a88-3428f43d590a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.806201 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb694a-3ac8-4164-8ae3-10eaefde2ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.806849 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb694a-3ac8-4164-8ae3-10eaefde2ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.807126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb694a-3ac8-4164-8ae3-10eaefde2ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.807435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb694a-3ac8-4164-8ae3-10eaefde2ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.811672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1334/2666] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:03.811812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb694a-3ac8-4164-8ae3-10eaefde2ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.811812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb694a-3ac8-4164-8ae3-10eaefde2ea6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.813194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3c8fc-092c-4e3a-a510-c35ac9671ecc admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.821079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1333/2667] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:06:03.825152 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb694a-3ac8-4164-8ae3-10eaefde2ea6 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.835440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb694a-3ac8-4164-8ae3-10eaefde2ea6 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.873438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3c8fc-092c-4e3a-a510-c35ac9671ecc admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.878729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990e85b-0cae-47ea-bba5-e97b43005bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.879504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e85b-0cae-47ea-bba5-e97b43005bfd admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.879789 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e85b-0cae-47ea-bba5-e97b43005bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.880063 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e85b-0cae-47ea-bba5-e97b43005bfd admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.880751 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990e85b-0cae-47ea-bba5-e97b43005bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.882693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990e85b-0cae-47ea-bba5-e97b43005bfd admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.891807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5827b7-1854-4183-9db9-9b077a4611b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.892510 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5827b7-1854-4183-9db9-9b077a4611b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.892794 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5827b7-1854-4183-9db9-9b077a4611b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.893070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5827b7-1854-4183-9db9-9b077a4611b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.894085 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5827b7-1854-4183-9db9-9b077a4611b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.896286 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5827b7-1854-4183-9db9-9b077a4611b6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.902778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1335/2668] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:03.906848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990e85b-0cae-47ea-bba5-e97b43005bfd admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.907004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1334/2669] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:06:03.910677 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5827b7-1854-4183-9db9-9b077a4611b6 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.919722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990e85b-0cae-47ea-bba5-e97b43005bfd admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.920686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5827b7-1854-4183-9db9-9b077a4611b6 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.924429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005c1bd-94ee-461e-af7d-7cce40cd45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.925081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005c1bd-94ee-461e-af7d-7cce40cd45e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.925322 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43860e51-1099-43d4-b1cf-3fcaedb61dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:03.925451 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005c1bd-94ee-461e-af7d-7cce40cd45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.925628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005c1bd-94ee-461e-af7d-7cce40cd45e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.926217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43860e51-1099-43d4-b1cf-3fcaedb61dde admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.926367 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005c1bd-94ee-461e-af7d-7cce40cd45e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.926550 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43860e51-1099-43d4-b1cf-3fcaedb61dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.926799 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43860e51-1099-43d4-b1cf-3fcaedb61dde admin admin] PATH_INFO: `/v3/projects/d0aebf73b3104885ba0b3be73a0a6a3c/users/0bc024d4666740fa9d798f04c4d50850/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.927977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005c1bd-94ee-461e-af7d-7cce40cd45e1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.938607 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1336/2670] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:06:03.942303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43860e51-1099-43d4-b1cf-3fcaedb61dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0aebf73b3104885ba0b3be73a0a6a3c, user_id=0bc024d4666740fa9d798f04c4d50850, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:03.942495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005c1bd-94ee-461e-af7d-7cce40cd45e1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:03.945256 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43860e51-1099-43d4-b1cf-3fcaedb61dde admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:03.952693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005c1bd-94ee-461e-af7d-7cce40cd45e1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:03.958060 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1335/2671] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:03 2022] PUT /identity/v3/projects/d0aebf73b3104885ba0b3be73a0a6a3c/users/0bc024d4666740fa9d798f04c4d50850/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:03.968846 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997810d0-df45-4c30-9dad-2e1cddc50d3b None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:03.969134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997810d0-df45-4c30-9dad-2e1cddc50d3b None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:03.969413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997810d0-df45-4c30-9dad-2e1cddc50d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:03.996102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-997810d0-df45-4c30-9dad-2e1cddc50d3b None None] MFA Rules not processed for user `0bc024d4666740fa9d798f04c4d50850`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:03.997348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-997810d0-df45-4c30-9dad-2e1cddc50d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:04.008218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23cc3-162f-401a-ba14-5bbd9adc4dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.008895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23cc3-162f-401a-ba14-5bbd9adc4dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.009178 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23cc3-162f-401a-ba14-5bbd9adc4dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.009460 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23cc3-162f-401a-ba14-5bbd9adc4dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.010198 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23cc3-162f-401a-ba14-5bbd9adc4dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.011824 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23cc3-162f-401a-ba14-5bbd9adc4dc4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.021412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1337/2672] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:04.025554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23cc3-162f-401a-ba14-5bbd9adc4dc4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.035484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23cc3-162f-401a-ba14-5bbd9adc4dc4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.040152 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063bac-44df-4d63-9957-d3ae0014a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.041010 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063bac-44df-4d63-9957-d3ae0014a260 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.041293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063bac-44df-4d63-9957-d3ae0014a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.041720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063bac-44df-4d63-9957-d3ae0014a260 admin admin] PATH_INFO: `/v3/projects/884531f0781540feb2576175a5281179/users/121486bd364949c3b531f6135269b1f8/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.056484 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4063bac-44df-4d63-9957-d3ae0014a260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884531f0781540feb2576175a5281179, user_id=121486bd364949c3b531f6135269b1f8, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.059142 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4063bac-44df-4d63-9957-d3ae0014a260 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.061814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1336/2673] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:04.066539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997810d0-df45-4c30-9dad-2e1cddc50d3b None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.073410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1338/2674] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:04 2022] PUT /identity/v3/projects/884531f0781540feb2576175a5281179/users/121486bd364949c3b531f6135269b1f8/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:04.077356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997810d0-df45-4c30-9dad-2e1cddc50d3b None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.083735 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2742-c00f-4008-a698-c66aaa96a307 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.084019 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2742-c00f-4008-a698-c66aaa96a307 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.084294 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2742-c00f-4008-a698-c66aaa96a307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.110150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-4cdf2742-c00f-4008-a698-c66aaa96a307 None None] MFA Rules not processed for user `121486bd364949c3b531f6135269b1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:04.111394 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4cdf2742-c00f-4008-a698-c66aaa96a307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:04.132748 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7978-7d7c-432c-867f-47e5b8b6e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.133403 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7978-7d7c-432c-867f-47e5b8b6e4da admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.133684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7978-7d7c-432c-867f-47e5b8b6e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.133957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7978-7d7c-432c-867f-47e5b8b6e4da admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.134634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7978-7d7c-432c-867f-47e5b8b6e4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.136622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7978-7d7c-432c-867f-47e5b8b6e4da admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.164697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1337/2675] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:04 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:04.165618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7978-7d7c-432c-867f-47e5b8b6e4da admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.175885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1339/2676] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:04.186402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf2742-c00f-4008-a698-c66aaa96a307 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.187836 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-4cdf2742-c00f-4008-a698-c66aaa96a307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:04.226511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7978-7d7c-432c-867f-47e5b8b6e4da admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.231961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670288fd-0ca4-444b-9b65-d3c762344091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.232618 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670288fd-0ca4-444b-9b65-d3c762344091 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.232890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670288fd-0ca4-444b-9b65-d3c762344091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.233167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670288fd-0ca4-444b-9b65-d3c762344091 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.233833 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670288fd-0ca4-444b-9b65-d3c762344091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.235763 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670288fd-0ca4-444b-9b65-d3c762344091 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.243906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf2742-c00f-4008-a698-c66aaa96a307 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.259703 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1338/2677] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:04 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:04.260664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670288fd-0ca4-444b-9b65-d3c762344091 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.271523 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670288fd-0ca4-444b-9b65-d3c762344091 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.276180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46e11b-6f9c-46ec-a154-d57e0493f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.276836 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e11b-6f9c-46ec-a154-d57e0493f21c admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.277118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e11b-6f9c-46ec-a154-d57e0493f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.277430 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46e11b-6f9c-46ec-a154-d57e0493f21c admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.278704 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46e11b-6f9c-46ec-a154-d57e0493f21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.280319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46e11b-6f9c-46ec-a154-d57e0493f21c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.290307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1339/2678] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:04.294983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46e11b-6f9c-46ec-a154-d57e0493f21c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.297723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8173b-c1c8-454a-ba6f-f3296935a35c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.298377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8173b-c1c8-454a-ba6f-f3296935a35c service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.298661 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8173b-c1c8-454a-ba6f-f3296935a35c service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.298938 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8173b-c1c8-454a-ba6f-f3296935a35c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.304573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46e11b-6f9c-46ec-a154-d57e0493f21c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.309399 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fac7-85bb-49f4-8ff0-c2eea7130af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.310264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fac7-85bb-49f4-8ff0-c2eea7130af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.310659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fac7-85bb-49f4-8ff0-c2eea7130af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.310939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fac7-85bb-49f4-8ff0-c2eea7130af1 admin admin] PATH_INFO: `/v3/projects/a8f8166ecae64f738fa88ec6c40eebf8/users/2096267fe01349498c94940321ce7390/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.325724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748fac7-85bb-49f4-8ff0-c2eea7130af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f8166ecae64f738fa88ec6c40eebf8, user_id=2096267fe01349498c94940321ce7390, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.328344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748fac7-85bb-49f4-8ff0-c2eea7130af1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.341914 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1340/2679] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:04 2022] PUT /identity/v3/projects/a8f8166ecae64f738fa88ec6c40eebf8/users/2096267fe01349498c94940321ce7390/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:04.345656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fac7-85bb-49f4-8ff0-c2eea7130af1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.354458 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8173b-c1c8-454a-ba6f-f3296935a35c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.356589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8173b-c1c8-454a-ba6f-f3296935a35c service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.365499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1340/2680] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:06:04.407105 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fac7-85bb-49f4-8ff0-c2eea7130af1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.411882 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdd84c-f15b-4540-920e-7e552faf2a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.412549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd84c-f15b-4540-920e-7e552faf2a64 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.412927 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd84c-f15b-4540-920e-7e552faf2a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.413206 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd84c-f15b-4540-920e-7e552faf2a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.413928 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdd84c-f15b-4540-920e-7e552faf2a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.415536 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdd84c-f15b-4540-920e-7e552faf2a64 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.425499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1341/2681] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:06:04.429309 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8173b-c1c8-454a-ba6f-f3296935a35c service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.440192 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8173b-c1c8-454a-ba6f-f3296935a35c service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.445181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf1ce4-7b56-4888-a94f-2a230ab5678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.446060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf1ce4-7b56-4888-a94f-2a230ab5678f admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.446349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf1ce4-7b56-4888-a94f-2a230ab5678f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.446626 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf1ce4-7b56-4888-a94f-2a230ab5678f admin admin] PATH_INFO: `/v3/projects/a8f8166ecae64f738fa88ec6c40eebf8/users/2096267fe01349498c94940321ce7390/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.448647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf1ce4-7b56-4888-a94f-2a230ab5678f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f8166ecae64f738fa88ec6c40eebf8, user_id=2096267fe01349498c94940321ce7390, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.451891 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf1ce4-7b56-4888-a94f-2a230ab5678f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.462030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1341/2682] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:04 2022] PUT /identity/v3/projects/a8f8166ecae64f738fa88ec6c40eebf8/users/2096267fe01349498c94940321ce7390/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:04.473507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29fac-e87c-4dd8-ba77-3630b7ce42b6 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.473802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29fac-e87c-4dd8-ba77-3630b7ce42b6 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.474081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29fac-e87c-4dd8-ba77-3630b7ce42b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.500324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-70c29fac-e87c-4dd8-ba77-3630b7ce42b6 None None] MFA Rules not processed for user `2096267fe01349498c94940321ce7390`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:04.501686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-70c29fac-e87c-4dd8-ba77-3630b7ce42b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:04.571670 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1342/2683] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:04.583997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf1ce4-7b56-4888-a94f-2a230ab5678f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.641293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf1ce4-7b56-4888-a94f-2a230ab5678f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.645157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69fc5-fdfb-47d3-b55d-6a88da9b631a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.645853 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69fc5-fdfb-47d3-b55d-6a88da9b631a service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.646135 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69fc5-fdfb-47d3-b55d-6a88da9b631a service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.646392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69fc5-fdfb-47d3-b55d-6a88da9b631a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.658073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f69fc5-fdfb-47d3-b55d-6a88da9b631a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.658575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f69fc5-fdfb-47d3-b55d-6a88da9b631a service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.678739 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1342/2684] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:06:04.721542 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c29fac-e87c-4dd8-ba77-3630b7ce42b6 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:04.722944 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-70c29fac-e87c-4dd8-ba77-3630b7ce42b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:04.736729 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c29fac-e87c-4dd8-ba77-3630b7ce42b6 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:04.740680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471afc1e-dff4-45d4-8c16-4b83ebf8b9b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:04.741321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471afc1e-dff4-45d4-8c16-4b83ebf8b9b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:04.741768 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471afc1e-dff4-45d4-8c16-4b83ebf8b9b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:04.742045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471afc1e-dff4-45d4-8c16-4b83ebf8b9b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:04.798622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471afc1e-dff4-45d4-8c16-4b83ebf8b9b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:04.800099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471afc1e-dff4-45d4-8c16-4b83ebf8b9b4 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:04.808762 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1343/2685] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:07.640446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69fc5-fdfb-47d3-b55d-6a88da9b631a service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:07.700867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69fc5-fdfb-47d3-b55d-6a88da9b631a service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:07.705604 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:07.706468 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:07.706800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:07.706998 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] PATH_INFO: `/v3/users/b9e8eb67f16c4ff8b60b86604ee98a29` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:07.708208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e8eb67f16c4ff8b60b86604ee98a29)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:07.710111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:07.754826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e8eb67f16c4ff8b60b86604ee98a29'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:07.761476 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e8eb67f16c4ff8b60b86604ee98a29'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:07.769665 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e8eb67f16c4ff8b60b86604ee98a29'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:07.770295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e8eb67f16c4ff8b60b86604ee98a29'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:07.785279 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e8eb67f16c4ff8b60b86604ee98a29'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:07.791046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1343/2686] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:07 2022] DELETE /identity/v3/users/b9e8eb67f16c4ff8b60b86604ee98a29 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:07.795726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28805a35-f3f3-4f05-b6d4-ca49d428cf91 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:07.796198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28805a35-f3f3-4f05-b6d4-ca49d428cf91 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:07.796319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28805a35-f3f3-4f05-b6d4-ca49d428cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:07.813349 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-28805a35-f3f3-4f05-b6d4-ca49d428cf91 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:07.814521 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-28805a35-f3f3-4f05-b6d4-ca49d428cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:07.869368 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1344/2687] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:07.879259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:07.880722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:07.936676 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ad308-c299-4e62-b7d1-5bde9a843da7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:07.940264 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb225d-5f57-401f-9b33-98670a824bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:07.940894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb225d-5f57-401f-9b33-98670a824bab service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:07.941174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb225d-5f57-401f-9b33-98670a824bab service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:07.941487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb225d-5f57-401f-9b33-98670a824bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:07.950989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb225d-5f57-401f-9b33-98670a824bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:07.952450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb225d-5f57-401f-9b33-98670a824bab service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:07.961627 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1344/2688] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:08.222692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28805a35-f3f3-4f05-b6d4-ca49d428cf91 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:08.224287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-28805a35-f3f3-4f05-b6d4-ca49d428cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:08.237021 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28805a35-f3f3-4f05-b6d4-ca49d428cf91 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:08.241625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:08.242580 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:08.242868 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:08.243141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] PATH_INFO: `/v3/projects/0a1293c92cd34bdabdd8b7b2f2260c61` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:08.244365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1293c92cd34bdabdd8b7b2f2260c61)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:08.246246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:08.292796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1293c92cd34bdabdd8b7b2f2260c61', 'request_id': 'req-3279a543-b829-4f84-9057-674cd6ac286d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.298837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1293c92cd34bdabdd8b7b2f2260c61', 'request_id': 'req-3279a543-b829-4f84-9057-674cd6ac286d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.308216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1293c92cd34bdabdd8b7b2f2260c61', 'request_id': 'req-3279a543-b829-4f84-9057-674cd6ac286d'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.319796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] The token cache is being invalidate because project 0a1293c92cd34bdabdd8b7b2f2260c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:08.320081 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.320697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.322231 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1345/2689] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:08 2022] DELETE /identity/v3/projects/0a1293c92cd34bdabdd8b7b2f2260c61 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:08.326175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb225d-5f57-401f-9b33-98670a824bab service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:08.335629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb225d-5f57-401f-9b33-98670a824bab service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:08.389888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:08.390848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:08.391037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:08.391336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] PATH_INFO: `/v3/users/0bc024d4666740fa9d798f04c4d50850` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:08.392519 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc024d4666740fa9d798f04c4d50850)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:08.394420 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:08.445456 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc024d4666740fa9d798f04c4d50850'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.452514 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc024d4666740fa9d798f04c4d50850'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.459567 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc024d4666740fa9d798f04c4d50850'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.460180 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc024d4666740fa9d798f04c4d50850'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.472668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc024d4666740fa9d798f04c4d50850'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.478523 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1345/2690] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:08 2022] DELETE /identity/v3/users/0bc024d4666740fa9d798f04c4d50850 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:08.747246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:08.748758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:08.764381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a543-b829-4f84-9057-674cd6ac286d admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:08.822249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:08.823113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:08.823423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:08.823697 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] PATH_INFO: `/v3/projects/d0aebf73b3104885ba0b3be73a0a6a3c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:08.825408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0aebf73b3104885ba0b3be73a0a6a3c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:08.827483 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:08.871996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0aebf73b3104885ba0b3be73a0a6a3c', 'request_id': 'req-a604e3cd-a99d-451c-93ac-eb6e31354bdc'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.877287 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0aebf73b3104885ba0b3be73a0a6a3c', 'request_id': 'req-a604e3cd-a99d-451c-93ac-eb6e31354bdc'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.884124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0aebf73b3104885ba0b3be73a0a6a3c', 'request_id': 'req-a604e3cd-a99d-451c-93ac-eb6e31354bdc'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.895323 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] The token cache is being invalidate because project d0aebf73b3104885ba0b3be73a0a6a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:08.895600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.896219 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:08.897714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1346/2691] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:08 2022] DELETE /identity/v3/projects/d0aebf73b3104885ba0b3be73a0a6a3c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:08.901796 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:08.903814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:08.916221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ea911-c435-4fc3-8ce4-5b4a6d8c21c8 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:08.981747 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:08.982547 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:08.982828 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:08.983105 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] PATH_INFO: `/v3/users/2096267fe01349498c94940321ce7390` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:08.984336 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2096267fe01349498c94940321ce7390)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:08.986266 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:09.033900 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2096267fe01349498c94940321ce7390'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.040632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2096267fe01349498c94940321ce7390'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.047229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2096267fe01349498c94940321ce7390'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.047865 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2096267fe01349498c94940321ce7390'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.059253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-e09eeda7-bd6e-48e8-afba-dd1396716ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2096267fe01349498c94940321ce7390'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.065118 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1346/2692] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:08 2022] DELETE /identity/v3/users/2096267fe01349498c94940321ce7390 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:09.332111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:09.333587 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:09.346994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604e3cd-a99d-451c-93ac-eb6e31354bdc admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:09.402779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:09.403676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.403955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.404227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] PATH_INFO: `/v3/projects/a8f8166ecae64f738fa88ec6c40eebf8` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.405402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f8166ecae64f738fa88ec6c40eebf8)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:09.407315 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:09.452126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f8166ecae64f738fa88ec6c40eebf8', 'request_id': 'req-70d8ad92-e020-4993-ab35-b1a699f7416c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.457446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f8166ecae64f738fa88ec6c40eebf8', 'request_id': 'req-70d8ad92-e020-4993-ab35-b1a699f7416c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.465194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f8166ecae64f738fa88ec6c40eebf8', 'request_id': 'req-70d8ad92-e020-4993-ab35-b1a699f7416c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.476089 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] The token cache is being invalidate because project a8f8166ecae64f738fa88ec6c40eebf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:09.484863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.484863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-70d8ad92-e020-4993-ab35-b1a699f7416c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:09.484863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1347/2693] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:09 2022] DELETE /identity/v3/projects/a8f8166ecae64f738fa88ec6c40eebf8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:09.485236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a56e-f9a2-4374-ab58-93df32eceb35 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.485236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a56e-f9a2-4374-ab58-93df32eceb35 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.485236 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a56e-f9a2-4374-ab58-93df32eceb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.504735 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9778a56e-f9a2-4374-ab58-93df32eceb35 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:09.505974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9778a56e-f9a2-4374-ab58-93df32eceb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:09.561655 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1347/2694] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:09.570435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974d4b-5b0d-4c36-9d9c-d89eb5426c2e None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.570719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974d4b-5b0d-4c36-9d9c-d89eb5426c2e None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.570992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974d4b-5b0d-4c36-9d9c-d89eb5426c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.589895 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-89974d4b-5b0d-4c36-9d9c-d89eb5426c2e None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:09.591087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-89974d4b-5b0d-4c36-9d9c-d89eb5426c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:09.598838 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1348/2695] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:09.602945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a56e-f9a2-4374-ab58-93df32eceb35 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:09.613008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a56e-f9a2-4374-ab58-93df32eceb35 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:09.617629 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:09.618275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.618564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.618843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.619601 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:09.619905 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:09.621493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:09.633159 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1348/2696] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:06:09.637260 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974d4b-5b0d-4c36-9d9c-d89eb5426c2e None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:09.646406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974d4b-5b0d-4c36-9d9c-d89eb5426c2e None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:09.651080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf99-a39d-4e65-81b2-21192620cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:09.651757 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf99-a39d-4e65-81b2-21192620cdf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.652035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf99-a39d-4e65-81b2-21192620cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.652304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf99-a39d-4e65-81b2-21192620cdf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.653020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191bf99-a39d-4e65-81b2-21192620cdf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:09.654881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191bf99-a39d-4e65-81b2-21192620cdf0 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:09.679999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1349/2697] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:09 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:09.684728 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:09.695209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef6f17-35fa-4458-b208-e678ae64ffca admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:09.751973 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083772d-043a-4215-8cf6-c1c939e26f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:09.753029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083772d-043a-4215-8cf6-c1c939e26f2c admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.753029 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083772d-043a-4215-8cf6-c1c939e26f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.753416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083772d-043a-4215-8cf6-c1c939e26f2c admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.754123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083772d-043a-4215-8cf6-c1c939e26f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:09.756158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083772d-043a-4215-8cf6-c1c939e26f2c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:09.779111 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1349/2698] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:09 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:09.780527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf99-a39d-4e65-81b2-21192620cdf0 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:09.791819 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf99-a39d-4e65-81b2-21192620cdf0 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:09.797630 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeb1a3-0630-4179-9474-999969155565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:09.798366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb1a3-0630-4179-9474-999969155565 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.798567 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb1a3-0630-4179-9474-999969155565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.798847 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb1a3-0630-4179-9474-999969155565 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.799634 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb1a3-0630-4179-9474-999969155565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:09.801209 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb1a3-0630-4179-9474-999969155565 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:09.812597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1350/2699] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:09.816564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083772d-043a-4215-8cf6-c1c939e26f2c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:09.827456 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083772d-043a-4215-8cf6-c1c939e26f2c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:09.832967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a3607-55e0-4b4c-8851-90d5414a88d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:09.833634 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a3607-55e0-4b4c-8851-90d5414a88d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.833999 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a3607-55e0-4b4c-8851-90d5414a88d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.834363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a3607-55e0-4b4c-8851-90d5414a88d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.835101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a3607-55e0-4b4c-8851-90d5414a88d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:09.836840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a3607-55e0-4b4c-8851-90d5414a88d6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:09.850356 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1350/2700] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:09.851716 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeb1a3-0630-4179-9474-999969155565 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:09.867725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeb1a3-0630-4179-9474-999969155565 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:09.873220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a0f6-a5a5-4ccc-8c37-d7ab2e257f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:09.874158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a0f6-a5a5-4ccc-8c37-d7ab2e257f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.874410 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a0f6-a5a5-4ccc-8c37-d7ab2e257f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.874685 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6a0f6-a5a5-4ccc-8c37-d7ab2e257f59 admin admin] PATH_INFO: `/v3/projects/c955dae0478546209e3a6dc177281bc3/users/49403a2d60294f90a02de7ae00a0352c/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.894709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a0f6-a5a5-4ccc-8c37-d7ab2e257f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c955dae0478546209e3a6dc177281bc3, user_id=49403a2d60294f90a02de7ae00a0352c, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:09.897186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6a0f6-a5a5-4ccc-8c37-d7ab2e257f59 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:09.910497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1351/2701] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:09 2022] PUT /identity/v3/projects/c955dae0478546209e3a6dc177281bc3/users/49403a2d60294f90a02de7ae00a0352c/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:09.923745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035874-4def-4359-9f6c-652312a7267c None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:09.924204 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035874-4def-4359-9f6c-652312a7267c None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:09.924312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035874-4def-4359-9f6c-652312a7267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:09.953714 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-28035874-4def-4359-9f6c-652312a7267c None None] MFA Rules not processed for user `49403a2d60294f90a02de7ae00a0352c`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:09.954921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-28035874-4def-4359-9f6c-652312a7267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:10.016949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1351/2702] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:10.021652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a0f6-a5a5-4ccc-8c37-d7ab2e257f59 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:10.083203 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6a0f6-a5a5-4ccc-8c37-d7ab2e257f59 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:10.089094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4202b7-a321-4a28-9067-22fa12eed296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:10.089756 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4202b7-a321-4a28-9067-22fa12eed296 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.090032 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4202b7-a321-4a28-9067-22fa12eed296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.090801 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4202b7-a321-4a28-9067-22fa12eed296 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.091543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4202b7-a321-4a28-9067-22fa12eed296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:10.093597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4202b7-a321-4a28-9067-22fa12eed296 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:10.118798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1352/2703] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:10 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:10.122974 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28035874-4def-4359-9f6c-652312a7267c None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:10.133545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28035874-4def-4359-9f6c-652312a7267c None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:10.188214 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa11b2-6030-460c-9f3b-c5357d1d7b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:10.188877 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa11b2-6030-460c-9f3b-c5357d1d7b24 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.189151 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa11b2-6030-460c-9f3b-c5357d1d7b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.189417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa11b2-6030-460c-9f3b-c5357d1d7b24 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.190100 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa11b2-6030-460c-9f3b-c5357d1d7b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:10.192043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa11b2-6030-460c-9f3b-c5357d1d7b24 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:10.211851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1352/2704] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:10 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:10.216339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4202b7-a321-4a28-9067-22fa12eed296 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:10.226571 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4202b7-a321-4a28-9067-22fa12eed296 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:10.231747 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3160a-6a39-4fff-87c0-14fec46ebf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:10.232395 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3160a-6a39-4fff-87c0-14fec46ebf72 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.232676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3160a-6a39-4fff-87c0-14fec46ebf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.232953 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3160a-6a39-4fff-87c0-14fec46ebf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.233701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3160a-6a39-4fff-87c0-14fec46ebf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:10.235313 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3160a-6a39-4fff-87c0-14fec46ebf72 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:10.245525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1353/2705] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:10.249433 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa11b2-6030-460c-9f3b-c5357d1d7b24 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:10.259221 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa11b2-6030-460c-9f3b-c5357d1d7b24 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:10.263850 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99889d3e-96f9-4f7c-8e6e-1dba929fdf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:10.264742 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889d3e-96f9-4f7c-8e6e-1dba929fdf0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.265016 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889d3e-96f9-4f7c-8e6e-1dba929fdf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.265286 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889d3e-96f9-4f7c-8e6e-1dba929fdf0b admin admin] PATH_INFO: `/v3/projects/0861a30b79ac42b9ab38153eef391eaf/users/7c6f0267bdcd4b6a8988d6fd02a1aca6/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.279902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99889d3e-96f9-4f7c-8e6e-1dba929fdf0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0861a30b79ac42b9ab38153eef391eaf, user_id=7c6f0267bdcd4b6a8988d6fd02a1aca6, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:10.282477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99889d3e-96f9-4f7c-8e6e-1dba929fdf0b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:10.295949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1353/2706] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:10 2022] PUT /identity/v3/projects/0861a30b79ac42b9ab38153eef391eaf/users/7c6f0267bdcd4b6a8988d6fd02a1aca6/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:10.299803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3160a-6a39-4fff-87c0-14fec46ebf72 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:10.309627 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3160a-6a39-4fff-87c0-14fec46ebf72 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:10.364163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c9ef9-39dc-4fe9-badb-5e061202be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:10.364815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9ef9-39dc-4fe9-badb-5e061202be7c admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.365098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9ef9-39dc-4fe9-badb-5e061202be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.365376 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9ef9-39dc-4fe9-badb-5e061202be7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.366091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c9ef9-39dc-4fe9-badb-5e061202be7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:10.367714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c9ef9-39dc-4fe9-badb-5e061202be7c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:10.377080 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1354/2707] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:06:10.381112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99889d3e-96f9-4f7c-8e6e-1dba929fdf0b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:10.391603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99889d3e-96f9-4f7c-8e6e-1dba929fdf0b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:10.396099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:10.396966 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.397243 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.397512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] PATH_INFO: `/v3/projects/0861a30b79ac42b9ab38153eef391eaf/users/7c6f0267bdcd4b6a8988d6fd02a1aca6/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.399503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0861a30b79ac42b9ab38153eef391eaf, user_id=7c6f0267bdcd4b6a8988d6fd02a1aca6, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:10.402088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:10.412453 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1354/2708] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:10 2022] PUT /identity/v3/projects/0861a30b79ac42b9ab38153eef391eaf/users/7c6f0267bdcd4b6a8988d6fd02a1aca6/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:10.422113 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec6679-9c4d-44fa-8d3b-49cdb9ea6141 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.422407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec6679-9c4d-44fa-8d3b-49cdb9ea6141 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.422714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec6679-9c4d-44fa-8d3b-49cdb9ea6141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.448434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-8dec6679-9c4d-44fa-8d3b-49cdb9ea6141 None None] MFA Rules not processed for user `7c6f0267bdcd4b6a8988d6fd02a1aca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:10.450103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8dec6679-9c4d-44fa-8d3b-49cdb9ea6141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:10.517069 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1355/2709] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:10.532870 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:10.534613 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:10.592908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39965-cbd3-4a54-811b-9bc8f081982b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:10.596577 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eff818-f0c8-4cac-9ac5-42b31c3fec4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:10.597222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff818-f0c8-4cac-9ac5-42b31c3fec4f service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.597505 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff818-f0c8-4cac-9ac5-42b31c3fec4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.597775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff818-f0c8-4cac-9ac5-42b31c3fec4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.606733 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eff818-f0c8-4cac-9ac5-42b31c3fec4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:10.608230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eff818-f0c8-4cac-9ac5-42b31c3fec4f service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:10.617734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1355/2710] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:10.686710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec6679-9c4d-44fa-8d3b-49cdb9ea6141 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:10.688227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-8dec6679-9c4d-44fa-8d3b-49cdb9ea6141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:10.703651 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec6679-9c4d-44fa-8d3b-49cdb9ea6141 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:10.707392 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff96a36-6666-4464-a6f4-b210711d9811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:10.708111 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff96a36-6666-4464-a6f4-b210711d9811 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:10.708394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff96a36-6666-4464-a6f4-b210711d9811 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:10.708684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff96a36-6666-4464-a6f4-b210711d9811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:10.764971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff96a36-6666-4464-a6f4-b210711d9811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:10.766402 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff96a36-6666-4464-a6f4-b210711d9811 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:10.775828 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1356/2711] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:11.089982 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eff818-f0c8-4cac-9ac5-42b31c3fec4f service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:11.155703 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eff818-f0c8-4cac-9ac5-42b31c3fec4f service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:11.161062 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:11.162161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:11.162502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:11.162840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] PATH_INFO: `/v3/users/49403a2d60294f90a02de7ae00a0352c` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:11.164259 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=49403a2d60294f90a02de7ae00a0352c)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:11.166183 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:11.225301 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49403a2d60294f90a02de7ae00a0352c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.235762 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49403a2d60294f90a02de7ae00a0352c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.248910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49403a2d60294f90a02de7ae00a0352c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.249581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49403a2d60294f90a02de7ae00a0352c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.262862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49403a2d60294f90a02de7ae00a0352c'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.268953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1356/2712] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:11 2022] DELETE /identity/v3/users/49403a2d60294f90a02de7ae00a0352c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:11.273554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2f1a-8f3d-4b4a-a33e-3f6455ce81f5 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:11.274041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2f1a-8f3d-4b4a-a33e-3f6455ce81f5 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:11.274161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2f1a-8f3d-4b4a-a33e-3f6455ce81f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:11.290779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-e43e2f1a-8f3d-4b4a-a33e-3f6455ce81f5 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:11.292688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e43e2f1a-8f3d-4b4a-a33e-3f6455ce81f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:11.353631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1357/2713] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:11.364042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:11.365459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:11.422559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa9b0-92b4-40e9-af60-6df9065d86ee admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:11.426298 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32159-2374-4de3-a866-0eeea72bb20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:11.426924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32159-2374-4de3-a866-0eeea72bb20a service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:11.427205 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32159-2374-4de3-a866-0eeea72bb20a service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:11.427504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32159-2374-4de3-a866-0eeea72bb20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:11.437363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32159-2374-4de3-a866-0eeea72bb20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:11.438637 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32159-2374-4de3-a866-0eeea72bb20a service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:11.449002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1357/2714] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:11.713525 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e2f1a-8f3d-4b4a-a33e-3f6455ce81f5 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:11.715754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e43e2f1a-8f3d-4b4a-a33e-3f6455ce81f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:11.728182 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e2f1a-8f3d-4b4a-a33e-3f6455ce81f5 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:11.735716 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:11.736698 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:11.737039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:11.737531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] PATH_INFO: `/v3/projects/c955dae0478546209e3a6dc177281bc3` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:11.740437 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c955dae0478546209e3a6dc177281bc3)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:11.743121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:11.791731 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c955dae0478546209e3a6dc177281bc3', 'request_id': 'req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.797558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c955dae0478546209e3a6dc177281bc3', 'request_id': 'req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.805807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c955dae0478546209e3a6dc177281bc3', 'request_id': 'req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.816874 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] The token cache is being invalidate because project c955dae0478546209e3a6dc177281bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:11.817154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.817766 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.819592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1358/2715] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:11 2022] DELETE /identity/v3/projects/c955dae0478546209e3a6dc177281bc3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:11.823545 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32159-2374-4de3-a866-0eeea72bb20a service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:11.833346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32159-2374-4de3-a866-0eeea72bb20a service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:11.887609 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:11.888497 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:11.888772 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:11.889038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] PATH_INFO: `/v3/users/7c6f0267bdcd4b6a8988d6fd02a1aca6` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:11.890217 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6f0267bdcd4b6a8988d6fd02a1aca6)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:11.892144 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:11.942933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6f0267bdcd4b6a8988d6fd02a1aca6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.950745 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6f0267bdcd4b6a8988d6fd02a1aca6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.958769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6f0267bdcd4b6a8988d6fd02a1aca6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.959412 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6f0267bdcd4b6a8988d6fd02a1aca6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.971713 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-5f87e7ce-8e54-406e-a75a-f635774b4208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6f0267bdcd4b6a8988d6fd02a1aca6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:11.977639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1358/2716] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:11 2022] DELETE /identity/v3/users/7c6f0267bdcd4b6a8988d6fd02a1aca6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:12.277345 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:12.278864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:12.291723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1876d-ee81-4562-b607-c09fe3aa1fbb admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:12.350920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:12.351929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.352285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.352631 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] PATH_INFO: `/v3/projects/0861a30b79ac42b9ab38153eef391eaf` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.353883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0861a30b79ac42b9ab38153eef391eaf)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:12.355930 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:12.402939 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0861a30b79ac42b9ab38153eef391eaf', 'request_id': 'req-12a01aa1-13b2-4a60-b673-f650c99549ba'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:12.408375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0861a30b79ac42b9ab38153eef391eaf', 'request_id': 'req-12a01aa1-13b2-4a60-b673-f650c99549ba'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:12.416227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0861a30b79ac42b9ab38153eef391eaf', 'request_id': 'req-12a01aa1-13b2-4a60-b673-f650c99549ba'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:12.427151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] The token cache is being invalidate because project 0861a30b79ac42b9ab38153eef391eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:12.427471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:12.428096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-12a01aa1-13b2-4a60-b673-f650c99549ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:12.429643 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1359/2717] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:12 2022] DELETE /identity/v3/projects/0861a30b79ac42b9ab38153eef391eaf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:12.436496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad0fb-d1f5-442d-9ec8-6f761c3c7b2d None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.436976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad0fb-d1f5-442d-9ec8-6f761c3c7b2d None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.437073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad0fb-d1f5-442d-9ec8-6f761c3c7b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.455912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a49ad0fb-d1f5-442d-9ec8-6f761c3c7b2d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:12.457107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a49ad0fb-d1f5-442d-9ec8-6f761c3c7b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:12.515736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1359/2718] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:12.525414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcbf67-659a-466e-b7e1-5a4e089ec84c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.525414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcbf67-659a-466e-b7e1-5a4e089ec84c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.525414 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcbf67-659a-466e-b7e1-5a4e089ec84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.544078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b4bcbf67-659a-466e-b7e1-5a4e089ec84c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:12.545261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b4bcbf67-659a-466e-b7e1-5a4e089ec84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:12.553168 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1360/2719] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:12.557281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad0fb-d1f5-442d-9ec8-6f761c3c7b2d None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:12.567575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad0fb-d1f5-442d-9ec8-6f761c3c7b2d None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:12.572410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:12.573065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.573346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.573620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.574377 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:12.575228 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:12.576890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:12.588906 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1360/2720] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:06:12.593406 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcbf67-659a-466e-b7e1-5a4e089ec84c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:12.602767 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcbf67-659a-466e-b7e1-5a4e089ec84c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:12.608141 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133c62-c33e-4b25-87c2-1b1e7b2dce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:12.608786 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133c62-c33e-4b25-87c2-1b1e7b2dce96 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.609070 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133c62-c33e-4b25-87c2-1b1e7b2dce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.609342 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133c62-c33e-4b25-87c2-1b1e7b2dce96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.610030 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa133c62-c33e-4b25-87c2-1b1e7b2dce96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:12.611961 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa133c62-c33e-4b25-87c2-1b1e7b2dce96 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:12.638295 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1361/2721] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:12 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:12.643004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:12.653369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258b2e-9f94-457c-9976-af015d17864d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:12.711445 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36525f3-b33c-485b-a38d-75604df7d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:12.712121 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36525f3-b33c-485b-a38d-75604df7d752 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.712405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36525f3-b33c-485b-a38d-75604df7d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.712768 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36525f3-b33c-485b-a38d-75604df7d752 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.713463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36525f3-b33c-485b-a38d-75604df7d752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:12.715431 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36525f3-b33c-485b-a38d-75604df7d752 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:12.738501 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1361/2722] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:12 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:12.741664 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133c62-c33e-4b25-87c2-1b1e7b2dce96 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:12.752196 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133c62-c33e-4b25-87c2-1b1e7b2dce96 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:12.756815 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb213b-18c5-4f94-8dfa-1685a8e75f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:12.757481 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb213b-18c5-4f94-8dfa-1685a8e75f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.757761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb213b-18c5-4f94-8dfa-1685a8e75f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.758039 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb213b-18c5-4f94-8dfa-1685a8e75f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.758798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb213b-18c5-4f94-8dfa-1685a8e75f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:12.760422 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb213b-18c5-4f94-8dfa-1685a8e75f3b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:12.771011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1362/2723] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:12.774731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36525f3-b33c-485b-a38d-75604df7d752 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:12.784894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36525f3-b33c-485b-a38d-75604df7d752 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:12.789730 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf4c6f-9dc5-4906-bb36-b9c07c86afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:12.790395 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4c6f-9dc5-4906-bb36-b9c07c86afd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.790684 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4c6f-9dc5-4906-bb36-b9c07c86afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.790947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4c6f-9dc5-4906-bb36-b9c07c86afd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.791731 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4c6f-9dc5-4906-bb36-b9c07c86afd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:12.793843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4c6f-9dc5-4906-bb36-b9c07c86afd0 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:12.803912 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1362/2724] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:06:12.807979 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb213b-18c5-4f94-8dfa-1685a8e75f3b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:12.818530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb213b-18c5-4f94-8dfa-1685a8e75f3b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:12.823802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:12.824734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.825010 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.825282 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] PATH_INFO: `/v3/projects/a2660bd3c29d440c89079cf7a4ee7a08/users/37e7537b0cbc478f8c98a22e388009c5/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.843864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2660bd3c29d440c89079cf7a4ee7a08, user_id=37e7537b0cbc478f8c98a22e388009c5, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:12.846547 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:12.859563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1363/2725] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:12 2022] PUT /identity/v3/projects/a2660bd3c29d440c89079cf7a4ee7a08/users/37e7537b0cbc478f8c98a22e388009c5/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:12.870408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95078ec-3f3e-439a-b749-98aecb91dc31 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:12.870701 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95078ec-3f3e-439a-b749-98aecb91dc31 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:12.871005 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95078ec-3f3e-439a-b749-98aecb91dc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:12.897474 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f95078ec-3f3e-439a-b749-98aecb91dc31 None None] MFA Rules not processed for user `37e7537b0cbc478f8c98a22e388009c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:12.898874 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f95078ec-3f3e-439a-b749-98aecb91dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:12.960213 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1363/2726] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:12.971191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:12.973057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:13.041860 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3934b3-4524-4e87-9472-6c8d07f650b3 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:13.045530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734c1a-51b8-44f5-b00f-4e1f635708be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:13.046170 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734c1a-51b8-44f5-b00f-4e1f635708be service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:13.046453 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734c1a-51b8-44f5-b00f-4e1f635708be service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:13.046726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734c1a-51b8-44f5-b00f-4e1f635708be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:13.054834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c734c1a-51b8-44f5-b00f-4e1f635708be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:13.056291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c734c1a-51b8-44f5-b00f-4e1f635708be service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:13.065444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1364/2727] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:22.453015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95078ec-3f3e-439a-b749-98aecb91dc31 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:22.454503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f95078ec-3f3e-439a-b749-98aecb91dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:22.519318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95078ec-3f3e-439a-b749-98aecb91dc31 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:22.523763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:22.524628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:22.524904 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:22.525175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] PATH_INFO: `/v3/users/121486bd364949c3b531f6135269b1f8` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:22.526346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=121486bd364949c3b531f6135269b1f8)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:22.528331 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:22.572663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121486bd364949c3b531f6135269b1f8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:22.579691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121486bd364949c3b531f6135269b1f8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:22.587015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121486bd364949c3b531f6135269b1f8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:22.587696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121486bd364949c3b531f6135269b1f8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:22.599093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121486bd364949c3b531f6135269b1f8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:22.604890 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1364/2728] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:22 2022] DELETE /identity/v3/users/121486bd364949c3b531f6135269b1f8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:22.610034 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b99a-242f-43a5-8698-c7a3ec5b561c None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:22.610562 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b99a-242f-43a5-8698-c7a3ec5b561c None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:22.610668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b99a-242f-43a5-8698-c7a3ec5b561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:22.627992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-24d0b99a-242f-43a5-8698-c7a3ec5b561c None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:22.629177 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-24d0b99a-242f-43a5-8698-c7a3ec5b561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:22.686735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1365/2729] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:22.696964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:22.698350 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:22.765777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817c0bf-da1e-4ff8-8de6-795bd56593fc admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:22.769648 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:22.770290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:22.770566 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:22.770833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:22.780295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:22.781708 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:22.790886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1365/2730] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:23.042383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b99a-242f-43a5-8698-c7a3ec5b561c None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:23.044590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-24d0b99a-242f-43a5-8698-c7a3ec5b561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:23.060366 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b99a-242f-43a5-8698-c7a3ec5b561c None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:23.068049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:23.072367 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:23.072663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:23.072945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] PATH_INFO: `/v3/projects/884531f0781540feb2576175a5281179` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:23.074230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=884531f0781540feb2576175a5281179)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:23.077042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:23.131539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884531f0781540feb2576175a5281179', 'request_id': 'req-6c5f48c0-8ddb-4e0b-a691-6891885de11e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.136771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884531f0781540feb2576175a5281179', 'request_id': 'req-6c5f48c0-8ddb-4e0b-a691-6891885de11e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.145502 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884531f0781540feb2576175a5281179', 'request_id': 'req-6c5f48c0-8ddb-4e0b-a691-6891885de11e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.157807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] The token cache is being invalidate because project 884531f0781540feb2576175a5281179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:23.158093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.158728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6c5f48c0-8ddb-4e0b-a691-6891885de11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.160459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1366/2731] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:23 2022] DELETE /identity/v3/projects/884531f0781540feb2576175a5281179 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:23.519507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:23.520009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:23.532532 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f3d3a-a83c-4ec0-9426-339ad146329c service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:23.587972 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:23.588764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:23.589042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:23.589308 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] PATH_INFO: `/v3/users/37e7537b0cbc478f8c98a22e388009c5` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:23.590472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e7537b0cbc478f8c98a22e388009c5)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:23.592489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:23.636820 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e7537b0cbc478f8c98a22e388009c5'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.644113 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e7537b0cbc478f8c98a22e388009c5'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.651149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e7537b0cbc478f8c98a22e388009c5'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.651800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e7537b0cbc478f8c98a22e388009c5'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.665102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e7537b0cbc478f8c98a22e388009c5'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:23.670919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1366/2732] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:23 2022] DELETE /identity/v3/users/37e7537b0cbc478f8c98a22e388009c5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:23.675429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070974dc-8c6a-4e20-8b75-c19f6ae9ac80 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:23.675911 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070974dc-8c6a-4e20-8b75-c19f6ae9ac80 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:23.676011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070974dc-8c6a-4e20-8b75-c19f6ae9ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:23.695309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-070974dc-8c6a-4e20-8b75-c19f6ae9ac80 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:23.696557 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-070974dc-8c6a-4e20-8b75-c19f6ae9ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:23.754674 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1367/2733] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:23.765004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:23.766457 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:23.823401 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad0498-2e4c-4639-be55-7bd4fd54afd4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:23.827670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8725d0-13a8-4541-8545-366d4aed33f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:23.828319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8725d0-13a8-4541-8545-366d4aed33f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:23.828597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8725d0-13a8-4541-8545-366d4aed33f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:23.828869 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8725d0-13a8-4541-8545-366d4aed33f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:23.838240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8725d0-13a8-4541-8545-366d4aed33f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:23.839639 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8725d0-13a8-4541-8545-366d4aed33f6 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:23.849065 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1367/2734] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:24.110507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070974dc-8c6a-4e20-8b75-c19f6ae9ac80 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.112062 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-070974dc-8c6a-4e20-8b75-c19f6ae9ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:24.126210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070974dc-8c6a-4e20-8b75-c19f6ae9ac80 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.131064 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.131942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.132216 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.132484 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] PATH_INFO: `/v3/projects/a2660bd3c29d440c89079cf7a4ee7a08` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.133680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2660bd3c29d440c89079cf7a4ee7a08)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.135600 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.179821 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2660bd3c29d440c89079cf7a4ee7a08', 'request_id': 'req-36fa2e00-022b-46a6-a77f-8801b5eaf181'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:24.185713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2660bd3c29d440c89079cf7a4ee7a08', 'request_id': 'req-36fa2e00-022b-46a6-a77f-8801b5eaf181'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:24.193122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2660bd3c29d440c89079cf7a4ee7a08', 'request_id': 'req-36fa2e00-022b-46a6-a77f-8801b5eaf181'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:24.204759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] The token cache is being invalidate because project a2660bd3c29d440c89079cf7a4ee7a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:24.205044 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:24.205676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-36fa2e00-022b-46a6-a77f-8801b5eaf181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:24.207446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1368/2735] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:24 2022] DELETE /identity/v3/projects/a2660bd3c29d440c89079cf7a4ee7a08 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:24.212038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815e77-3b69-4786-b65e-8b60291767fa None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.212324 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815e77-3b69-4786-b65e-8b60291767fa None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.212594 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815e77-3b69-4786-b65e-8b60291767fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.230463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-9d815e77-3b69-4786-b65e-8b60291767fa None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:24.232284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-9d815e77-3b69-4786-b65e-8b60291767fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:24.289187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1368/2736] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:24.297499 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b0a0-95ed-4419-a153-d1da84902c94 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.297788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b0a0-95ed-4419-a153-d1da84902c94 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.298066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b0a0-95ed-4419-a153-d1da84902c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.315941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-4e15b0a0-95ed-4419-a153-d1da84902c94 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:24.317140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-4e15b0a0-95ed-4419-a153-d1da84902c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:24.325197 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1369/2737] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:24.329075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d815e77-3b69-4786-b65e-8b60291767fa None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.338506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d815e77-3b69-4786-b65e-8b60291767fa None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.343587 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.344230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.344509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.344778 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.345489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:24.345790 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.347416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.358949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1369/2738] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 19:06:24.362841 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15b0a0-95ed-4419-a153-d1da84902c94 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.371827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15b0a0-95ed-4419-a153-d1da84902c94 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.376441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27ff6f-82c8-4253-8265-f23fd4123c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.377071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ff6f-82c8-4253-8265-f23fd4123c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.377351 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ff6f-82c8-4253-8265-f23fd4123c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.377622 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ff6f-82c8-4253-8265-f23fd4123c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.378309 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27ff6f-82c8-4253-8265-f23fd4123c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.380222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27ff6f-82c8-4253-8265-f23fd4123c33 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.405294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1370/2739] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:24 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:24.409693 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.420075 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54446e-fd51-4e6a-baa1-c4cd0583fec4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.473579 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b72ac-6812-4eae-9b3a-226c64a358f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.474240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b72ac-6812-4eae-9b3a-226c64a358f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.474515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b72ac-6812-4eae-9b3a-226c64a358f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.474781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b72ac-6812-4eae-9b3a-226c64a358f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.475490 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b72ac-6812-4eae-9b3a-226c64a358f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.477389 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b72ac-6812-4eae-9b3a-226c64a358f5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.496810 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1370/2740] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:24 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:24.500973 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27ff6f-82c8-4253-8265-f23fd4123c33 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.511035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27ff6f-82c8-4253-8265-f23fd4123c33 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.515887 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd711-b915-41f5-9a73-ea08040aad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.516538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd711-b915-41f5-9a73-ea08040aad9a admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.516817 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd711-b915-41f5-9a73-ea08040aad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.517091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd711-b915-41f5-9a73-ea08040aad9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.517875 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dd711-b915-41f5-9a73-ea08040aad9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.519468 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dd711-b915-41f5-9a73-ea08040aad9a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.530654 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1371/2741] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:24.534495 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b72ac-6812-4eae-9b3a-226c64a358f5 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.544528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b72ac-6812-4eae-9b3a-226c64a358f5 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.549894 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7658d7-79bc-4249-9229-ceed5f4d98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.550674 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7658d7-79bc-4249-9229-ceed5f4d98b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.550833 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7658d7-79bc-4249-9229-ceed5f4d98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.551106 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7658d7-79bc-4249-9229-ceed5f4d98b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.551930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7658d7-79bc-4249-9229-ceed5f4d98b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.553450 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7658d7-79bc-4249-9229-ceed5f4d98b5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.564188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1371/2742] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:24.568339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd711-b915-41f5-9a73-ea08040aad9a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.578455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd711-b915-41f5-9a73-ea08040aad9a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.583372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda574cb-2084-4931-818a-f8c159409d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.584249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda574cb-2084-4931-818a-f8c159409d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.584530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda574cb-2084-4931-818a-f8c159409d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.584803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda574cb-2084-4931-818a-f8c159409d88 admin admin] PATH_INFO: `/v3/projects/f515771460094d6693ae7f11845d2a38/users/e773d4fecfa34819b2b6c8c597a4cf19/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.599764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda574cb-2084-4931-818a-f8c159409d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f515771460094d6693ae7f11845d2a38, user_id=e773d4fecfa34819b2b6c8c597a4cf19, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.602475 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda574cb-2084-4931-818a-f8c159409d88 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.617328 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1372/2743] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:24 2022] PUT /identity/v3/projects/f515771460094d6693ae7f11845d2a38/users/e773d4fecfa34819b2b6c8c597a4cf19/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:24.629748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b38dd-6526-4007-81db-c6df9bd41dd6 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.630327 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b38dd-6526-4007-81db-c6df9bd41dd6 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.630722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b38dd-6526-4007-81db-c6df9bd41dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.660942 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-059b38dd-6526-4007-81db-c6df9bd41dd6 None None] MFA Rules not processed for user `e773d4fecfa34819b2b6c8c597a4cf19`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:24.662132 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-059b38dd-6526-4007-81db-c6df9bd41dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:24.723404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1372/2744] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:24.727957 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda574cb-2084-4931-818a-f8c159409d88 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.793013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda574cb-2084-4931-818a-f8c159409d88 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.798890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c3be5-8523-4f3e-8992-37b31f830313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.799586 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3be5-8523-4f3e-8992-37b31f830313 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.799872 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3be5-8523-4f3e-8992-37b31f830313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.800254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3be5-8523-4f3e-8992-37b31f830313 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.800956 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c3be5-8523-4f3e-8992-37b31f830313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.802907 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c3be5-8523-4f3e-8992-37b31f830313 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.828798 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1373/2745] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:24 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:24.833034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b38dd-6526-4007-81db-c6df9bd41dd6 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.843471 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b38dd-6526-4007-81db-c6df9bd41dd6 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.899901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd772f8-e1c0-4371-ba42-252140cd1e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.900477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd772f8-e1c0-4371-ba42-252140cd1e1e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.900760 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd772f8-e1c0-4371-ba42-252140cd1e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.901038 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd772f8-e1c0-4371-ba42-252140cd1e1e admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.901734 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd772f8-e1c0-4371-ba42-252140cd1e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.903682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd772f8-e1c0-4371-ba42-252140cd1e1e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.923775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1373/2746] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:24 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:24.927870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c3be5-8523-4f3e-8992-37b31f830313 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.939389 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c3be5-8523-4f3e-8992-37b31f830313 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.944486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1bb7-57e4-4ea3-a9ed-398863c55abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.945145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1bb7-57e4-4ea3-a9ed-398863c55abc admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.945431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1bb7-57e4-4ea3-a9ed-398863c55abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.945708 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1bb7-57e4-4ea3-a9ed-398863c55abc admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.946446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1bb7-57e4-4ea3-a9ed-398863c55abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.948098 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1bb7-57e4-4ea3-a9ed-398863c55abc admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.958457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1374/2747] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:24.962315 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd772f8-e1c0-4371-ba42-252140cd1e1e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:24.972736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd772f8-e1c0-4371-ba42-252140cd1e1e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:24.977229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac96be9-1fcc-45f5-b3d1-cfec34efe0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:24.977893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac96be9-1fcc-45f5-b3d1-cfec34efe0ca admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:24.978169 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac96be9-1fcc-45f5-b3d1-cfec34efe0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:24.978441 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac96be9-1fcc-45f5-b3d1-cfec34efe0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:24.979149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac96be9-1fcc-45f5-b3d1-cfec34efe0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:24.981318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac96be9-1fcc-45f5-b3d1-cfec34efe0ca admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:24.990838 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1374/2748] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:24.994751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1bb7-57e4-4ea3-a9ed-398863c55abc admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.004531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1bb7-57e4-4ea3-a9ed-398863c55abc admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.009465 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b347c93-dcdb-4864-a534-f7b5c2792b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.010443 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347c93-dcdb-4864-a534-f7b5c2792b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.010727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347c93-dcdb-4864-a534-f7b5c2792b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.011011 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347c93-dcdb-4864-a534-f7b5c2792b9b admin admin] PATH_INFO: `/v3/projects/961a5996ea3a43669fbd8a049c7c6962/users/e1e36234d5a3449d8c6f83efa1c4c616/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.025165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b347c93-dcdb-4864-a534-f7b5c2792b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=961a5996ea3a43669fbd8a049c7c6962, user_id=e1e36234d5a3449d8c6f83efa1c4c616, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.028684 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b347c93-dcdb-4864-a534-f7b5c2792b9b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.040736 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1375/2749] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:24 2022] PUT /identity/v3/projects/961a5996ea3a43669fbd8a049c7c6962/users/e1e36234d5a3449d8c6f83efa1c4c616/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:25.051081 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766e6-ece1-4e2e-83a2-26caf695f86f None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.051409 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766e6-ece1-4e2e-83a2-26caf695f86f None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.051691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766e6-ece1-4e2e-83a2-26caf695f86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.077265 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-8a7766e6-ece1-4e2e-83a2-26caf695f86f None None] MFA Rules not processed for user `e1e36234d5a3449d8c6f83efa1c4c616`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:25.078467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-8a7766e6-ece1-4e2e-83a2-26caf695f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:25.147868 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1375/2750] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:25.152937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b347c93-dcdb-4864-a534-f7b5c2792b9b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.212244 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b347c93-dcdb-4864-a534-f7b5c2792b9b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.217511 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00de6ee-efc7-4060-90be-36b930a8edf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.218157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de6ee-efc7-4060-90be-36b930a8edf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.218439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de6ee-efc7-4060-90be-36b930a8edf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.218713 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de6ee-efc7-4060-90be-36b930a8edf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.219439 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00de6ee-efc7-4060-90be-36b930a8edf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.221327 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00de6ee-efc7-4060-90be-36b930a8edf9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.245754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1376/2751] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:25.249830 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7766e6-ece1-4e2e-83a2-26caf695f86f None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.260277 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7766e6-ece1-4e2e-83a2-26caf695f86f None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.314740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ceb90-7147-4694-929c-eca167c9a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.315488 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ceb90-7147-4694-929c-eca167c9a6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.315791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ceb90-7147-4694-929c-eca167c9a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.316053 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ceb90-7147-4694-929c-eca167c9a6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.316921 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ceb90-7147-4694-929c-eca167c9a6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.319079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ceb90-7147-4694-929c-eca167c9a6d1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.338215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1376/2752] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:25 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:25.342732 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00de6ee-efc7-4060-90be-36b930a8edf9 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.352782 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00de6ee-efc7-4060-90be-36b930a8edf9 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.357343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475216-97c0-4bf0-a398-ca302afdf158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.357994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475216-97c0-4bf0-a398-ca302afdf158 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.358292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475216-97c0-4bf0-a398-ca302afdf158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.358533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475216-97c0-4bf0-a398-ca302afdf158 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.359254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475216-97c0-4bf0-a398-ca302afdf158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.360850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475216-97c0-4bf0-a398-ca302afdf158 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.371041 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1377/2753] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:25.374885 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ceb90-7147-4694-929c-eca167c9a6d1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.384485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ceb90-7147-4694-929c-eca167c9a6d1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.389881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575e2e0-3fd9-486d-823d-b66ab3d9dfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.390750 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e2e0-3fd9-486d-823d-b66ab3d9dfa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.391030 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e2e0-3fd9-486d-823d-b66ab3d9dfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.391328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e2e0-3fd9-486d-823d-b66ab3d9dfa3 admin admin] PATH_INFO: `/v3/projects/64bb56fc1c75428b9d83ba93c002d7e7/users/293a51f56ec04813af819873e4806e53/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.406295 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575e2e0-3fd9-486d-823d-b66ab3d9dfa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bb56fc1c75428b9d83ba93c002d7e7, user_id=293a51f56ec04813af819873e4806e53, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.409045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575e2e0-3fd9-486d-823d-b66ab3d9dfa3 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.420791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1377/2754] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:25 2022] PUT /identity/v3/projects/64bb56fc1c75428b9d83ba93c002d7e7/users/293a51f56ec04813af819873e4806e53/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:25.424613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475216-97c0-4bf0-a398-ca302afdf158 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.434271 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475216-97c0-4bf0-a398-ca302afdf158 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.488189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289bac-0fad-4011-b780-6caf4149b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.488837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289bac-0fad-4011-b780-6caf4149b776 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.489116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289bac-0fad-4011-b780-6caf4149b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.489391 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289bac-0fad-4011-b780-6caf4149b776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.490099 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289bac-0fad-4011-b780-6caf4149b776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.491709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289bac-0fad-4011-b780-6caf4149b776 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.501048 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1378/2755] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:25.505039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575e2e0-3fd9-486d-823d-b66ab3d9dfa3 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.515776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575e2e0-3fd9-486d-823d-b66ab3d9dfa3 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.520364 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.521240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.521524 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.521795 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] PATH_INFO: `/v3/projects/64bb56fc1c75428b9d83ba93c002d7e7/users/293a51f56ec04813af819873e4806e53/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.523800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bb56fc1c75428b9d83ba93c002d7e7, user_id=293a51f56ec04813af819873e4806e53, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.526421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.536729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1378/2756] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:25 2022] PUT /identity/v3/projects/64bb56fc1c75428b9d83ba93c002d7e7/users/293a51f56ec04813af819873e4806e53/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:25.546807 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63869-ca9d-458f-a593-c2717cf6c320 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.547102 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63869-ca9d-458f-a593-c2717cf6c320 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.547448 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63869-ca9d-458f-a593-c2717cf6c320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.578642 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-56f63869-ca9d-458f-a593-c2717cf6c320 None None] MFA Rules not processed for user `293a51f56ec04813af819873e4806e53`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:25.580221 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-56f63869-ca9d-458f-a593-c2717cf6c320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:25.645513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1379/2757] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:25.657386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.660136 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:25.678588 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63869-ca9d-458f-a593-c2717cf6c320 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.680001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-56f63869-ca9d-458f-a593-c2717cf6c320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:25.719996 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d07396-6fa5-4201-9e57-9edbfd82d326 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.723743 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36460b4b-aa0e-4d4d-9453-8240b459f649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.724411 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36460b4b-aa0e-4d4d-9453-8240b459f649 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.724700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36460b4b-aa0e-4d4d-9453-8240b459f649 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.725008 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36460b4b-aa0e-4d4d-9453-8240b459f649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.742781 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63869-ca9d-458f-a593-c2717cf6c320 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.747934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.748802 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.749091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.749358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] PATH_INFO: `/v3/users/8df089cf91274c6596a4a7f2d351a39f` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.750566 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df089cf91274c6596a4a7f2d351a39f)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.752527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.781602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36460b4b-aa0e-4d4d-9453-8240b459f649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:25.783275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36460b4b-aa0e-4d4d-9453-8240b459f649 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:25.793190 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1379/2758] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:25.799284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df089cf91274c6596a4a7f2d351a39f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:25.806125 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df089cf91274c6596a4a7f2d351a39f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:25.806816 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df089cf91274c6596a4a7f2d351a39f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:25.815470 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df089cf91274c6596a4a7f2d351a39f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:25.816246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df089cf91274c6596a4a7f2d351a39f'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:25.834469 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1380/2759] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:25 2022] DELETE /identity/v3/users/8df089cf91274c6596a4a7f2d351a39f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:25.838944 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de2d7-5acc-4455-9363-2685cadc68f0 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.839240 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de2d7-5acc-4455-9363-2685cadc68f0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.839557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de2d7-5acc-4455-9363-2685cadc68f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:25.856557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-a28de2d7-5acc-4455-9363-2685cadc68f0 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:25.857763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a28de2d7-5acc-4455-9363-2685cadc68f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:25.915491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1380/2760] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:25.925810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:25.927401 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:25.987471 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dba56-2b94-4320-ada8-b5a6a6136b9f admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:25.991344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2257b-3c68-4972-ab78-9478242a6624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:25.992067 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2257b-3c68-4972-ab78-9478242a6624 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:25.992262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2257b-3c68-4972-ab78-9478242a6624 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:25.992539 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2257b-3c68-4972-ab78-9478242a6624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:26.002975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2257b-3c68-4972-ab78-9478242a6624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:26.004549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2257b-3c68-4972-ab78-9478242a6624 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:26.018087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1381/2761] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:26.284432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de2d7-5acc-4455-9363-2685cadc68f0 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:26.285847 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a28de2d7-5acc-4455-9363-2685cadc68f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:26.304466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de2d7-5acc-4455-9363-2685cadc68f0 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:26.310770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:26.311758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:26.312056 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:26.312281 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] PATH_INFO: `/v3/projects/b748d127eb044fae931f919dc0081d12` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:26.313557 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b748d127eb044fae931f919dc0081d12)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:26.315520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:26.359589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b748d127eb044fae931f919dc0081d12', 'request_id': 'req-125da447-807e-461d-b230-24b440be47b7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.366429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b748d127eb044fae931f919dc0081d12', 'request_id': 'req-125da447-807e-461d-b230-24b440be47b7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.372392 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b748d127eb044fae931f919dc0081d12', 'request_id': 'req-125da447-807e-461d-b230-24b440be47b7'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.383002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] The token cache is being invalidate because project b748d127eb044fae931f919dc0081d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:26.383290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.383943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.385454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1381/2762] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:26 2022] DELETE /identity/v3/projects/b748d127eb044fae931f919dc0081d12 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:26.389357 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2257b-3c68-4972-ab78-9478242a6624 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:26.398934 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2257b-3c68-4972-ab78-9478242a6624 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:26.459531 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:26.460338 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:26.460611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:26.460883 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] PATH_INFO: `/v3/users/c0de8fdc4ac2491397781c983cf81090` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:26.462047 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0de8fdc4ac2491397781c983cf81090)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:26.463996 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:26.507220 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0de8fdc4ac2491397781c983cf81090'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.513982 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0de8fdc4ac2491397781c983cf81090'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.514650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0de8fdc4ac2491397781c983cf81090'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.521179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0de8fdc4ac2491397781c983cf81090'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.521876 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-b75ded2e-3efa-4631-8413-1cd14d7dd008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0de8fdc4ac2491397781c983cf81090'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.538656 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1382/2763] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:26 2022] DELETE /identity/v3/users/c0de8fdc4ac2491397781c983cf81090 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:26.806210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:26.807729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:26.821549 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125da447-807e-461d-b230-24b440be47b7 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:26.876345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:26.877195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:26.877475 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:26.877746 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] PATH_INFO: `/v3/projects/297e217b9df946de84cef6b9178acd80` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:26.878919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297e217b9df946de84cef6b9178acd80)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:26.880845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:26.924323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297e217b9df946de84cef6b9178acd80', 'request_id': 'req-d3c2a568-61e4-4a85-a42a-ae2303592f06'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.930967 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297e217b9df946de84cef6b9178acd80', 'request_id': 'req-d3c2a568-61e4-4a85-a42a-ae2303592f06'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.936215 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297e217b9df946de84cef6b9178acd80', 'request_id': 'req-d3c2a568-61e4-4a85-a42a-ae2303592f06'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.946934 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] The token cache is being invalidate because project 297e217b9df946de84cef6b9178acd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:26.947216 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.947993 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d3c2a568-61e4-4a85-a42a-ae2303592f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:26.950002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1382/2764] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:26 2022] DELETE /identity/v3/projects/297e217b9df946de84cef6b9178acd80 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:26.954965 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb507-f68e-459a-9531-586bb14fabaa None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:26.955486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb507-f68e-459a-9531-586bb14fabaa None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:26.955603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb507-f68e-459a-9531-586bb14fabaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:26.973005 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-6d4bb507-f68e-459a-9531-586bb14fabaa None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:26.974183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6d4bb507-f68e-459a-9531-586bb14fabaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:27.031938 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1383/2765] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:27.039662 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d53d8-a327-43b9-a931-0bc4755fc8f1 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.039946 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d53d8-a327-43b9-a931-0bc4755fc8f1 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.040218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d53d8-a327-43b9-a931-0bc4755fc8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.058120 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e71d53d8-a327-43b9-a931-0bc4755fc8f1 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:27.059353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e71d53d8-a327-43b9-a931-0bc4755fc8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:27.067541 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1383/2766] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:27.072071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bb507-f68e-459a-9531-586bb14fabaa None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.082466 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bb507-f68e-459a-9531-586bb14fabaa None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.087189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.087903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.088184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.088457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.089183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:27.089490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.091680 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.103669 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1384/2767] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 19:06:27.108001 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d53d8-a327-43b9-a931-0bc4755fc8f1 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.117060 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d53d8-a327-43b9-a931-0bc4755fc8f1 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.121691 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211213-8fd4-4ea3-9065-396740bf78e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.122366 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211213-8fd4-4ea3-9065-396740bf78e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.122641 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211213-8fd4-4ea3-9065-396740bf78e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.122910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211213-8fd4-4ea3-9065-396740bf78e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.123626 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5211213-8fd4-4ea3-9065-396740bf78e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.125493 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5211213-8fd4-4ea3-9065-396740bf78e5 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.158430 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1384/2768] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:27 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:27.162711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.173261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc7b0-4fde-4901-9c11-9b7675c0cfda admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.231726 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.232383 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.232686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.232955 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.233672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.235857 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.256855 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1385/2769] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:27 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:27.260907 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211213-8fd4-4ea3-9065-396740bf78e5 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.273257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211213-8fd4-4ea3-9065-396740bf78e5 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.278125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c54a-1d79-43ac-8016-6ff3a116f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.278849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c54a-1d79-43ac-8016-6ff3a116f64b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.279195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c54a-1d79-43ac-8016-6ff3a116f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.279562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c54a-1d79-43ac-8016-6ff3a116f64b admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.280351 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317c54a-1d79-43ac-8016-6ff3a116f64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.282095 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317c54a-1d79-43ac-8016-6ff3a116f64b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.287812 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.289497 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:27.292650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1385/2770] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:27.298575 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c54a-1d79-43ac-8016-6ff3a116f64b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.308477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c54a-1d79-43ac-8016-6ff3a116f64b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.313764 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e121-3bda-4769-91bd-454e619ba2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.314465 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e121-3bda-4769-91bd-454e619ba2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.314744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e121-3bda-4769-91bd-454e619ba2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.315015 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e121-3bda-4769-91bd-454e619ba2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.315763 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e121-3bda-4769-91bd-454e619ba2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.317463 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e121-3bda-4769-91bd-454e619ba2c4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.328219 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1386/2771] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:27.332241 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e121-3bda-4769-91bd-454e619ba2c4 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.341859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e121-3bda-4769-91bd-454e619ba2c4 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.345858 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea5783-36e8-441e-bd82-c2fc5ab4e2f5 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.346425 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98624ad4-d8cc-4dd8-bb7d-bcef29709978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.347283 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98624ad4-d8cc-4dd8-bb7d-bcef29709978 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.347597 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98624ad4-d8cc-4dd8-bb7d-bcef29709978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.347871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98624ad4-d8cc-4dd8-bb7d-bcef29709978 admin admin] PATH_INFO: `/v3/projects/ddb3a09405b440779fd4ad55ada40839/users/77cd1c5dd3114aec8a1799c684a23807/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.349487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.350122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.350396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.350668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.352456 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:27.362381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98624ad4-d8cc-4dd8-bb7d-bcef29709978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb3a09405b440779fd4ad55ada40839, user_id=77cd1c5dd3114aec8a1799c684a23807, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.365160 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98624ad4-d8cc-4dd8-bb7d-bcef29709978 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.378491 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1387/2772] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:27 2022] PUT /identity/v3/projects/ddb3a09405b440779fd4ad55ada40839/users/77cd1c5dd3114aec8a1799c684a23807/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:27.389455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b83b-44ed-473c-b043-85cd1589e8c0 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.389741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b83b-44ed-473c-b043-85cd1589e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.390012 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b83b-44ed-473c-b043-85cd1589e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.410193 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.411672 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.414893 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-5659b83b-44ed-473c-b043-85cd1589e8c0 None None] MFA Rules not processed for user `77cd1c5dd3114aec8a1799c684a23807`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:27.416112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-5659b83b-44ed-473c-b043-85cd1589e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:27.421054 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1386/2773] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:06:27.479246 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1388/2774] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:27.483753 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.494262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27d681-72a7-46da-b898-faba85c94bb0 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.553175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e2144-41a1-4285-96df-ed4967aac33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.553863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e2144-41a1-4285-96df-ed4967aac33b admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.554186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e2144-41a1-4285-96df-ed4967aac33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.554444 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e2144-41a1-4285-96df-ed4967aac33b admin admin] PATH_INFO: `/v3/projects` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.555207 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e2144-41a1-4285-96df-ed4967aac33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.557232 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e2144-41a1-4285-96df-ed4967aac33b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.587031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1387/2775] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:27 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:27.588170 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b83b-44ed-473c-b043-85cd1589e8c0 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.599654 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b83b-44ed-473c-b043-85cd1589e8c0 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.659122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf06b1-f82f-4b46-9495-d0079be9259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.659834 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf06b1-f82f-4b46-9495-d0079be9259e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.660109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf06b1-f82f-4b46-9495-d0079be9259e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.660380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf06b1-f82f-4b46-9495-d0079be9259e admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.661077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf06b1-f82f-4b46-9495-d0079be9259e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.663003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf06b1-f82f-4b46-9495-d0079be9259e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.682611 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1389/2776] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:27 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:27.687625 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e2144-41a1-4285-96df-ed4967aac33b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.698513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e2144-41a1-4285-96df-ed4967aac33b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.703823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce5881-eb8d-47f3-b00b-f0b478e889eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.704537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce5881-eb8d-47f3-b00b-f0b478e889eb admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.704824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce5881-eb8d-47f3-b00b-f0b478e889eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.705096 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce5881-eb8d-47f3-b00b-f0b478e889eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.705825 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce5881-eb8d-47f3-b00b-f0b478e889eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.707455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce5881-eb8d-47f3-b00b-f0b478e889eb admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.719850 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1388/2777] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:06:27.724188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf06b1-f82f-4b46-9495-d0079be9259e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.735496 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf06b1-f82f-4b46-9495-d0079be9259e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.740263 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ba4e-b1ea-4ea5-af0b-96c87faf497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.741149 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ba4e-b1ea-4ea5-af0b-96c87faf497c admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.741435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ba4e-b1ea-4ea5-af0b-96c87faf497c admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.741705 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ba4e-b1ea-4ea5-af0b-96c87faf497c admin admin] PATH_INFO: `/v3/projects/334c2199091e40f2b001c38a4ff8e503/users/6653eb6e8a0c48cc83d8f2f6ea45f884/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.757843 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71ba4e-b1ea-4ea5-af0b-96c87faf497c admin admin] RBAC: Authorizing `identity:create_grant(project_id=334c2199091e40f2b001c38a4ff8e503, user_id=6653eb6e8a0c48cc83d8f2f6ea45f884, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.760621 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71ba4e-b1ea-4ea5-af0b-96c87faf497c admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.773779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1390/2778] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:27 2022] PUT /identity/v3/projects/334c2199091e40f2b001c38a4ff8e503/users/6653eb6e8a0c48cc83d8f2f6ea45f884/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:27.778042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce5881-eb8d-47f3-b00b-f0b478e889eb admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.788312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce5881-eb8d-47f3-b00b-f0b478e889eb admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.844765 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadd327-dece-4531-9d89-837d871ded53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.845435 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd327-dece-4531-9d89-837d871ded53 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.845717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd327-dece-4531-9d89-837d871ded53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.845991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd327-dece-4531-9d89-837d871ded53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.846720 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadd327-dece-4531-9d89-837d871ded53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.848340 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadd327-dece-4531-9d89-837d871ded53 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.861942 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1389/2779] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:27.863070 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ba4e-b1ea-4ea5-af0b-96c87faf497c admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.874050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ba4e-b1ea-4ea5-af0b-96c87faf497c admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.878563 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b606e-d8c0-48e9-b84d-34f210d2d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.879464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b606e-d8c0-48e9-b84d-34f210d2d752 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.879741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b606e-d8c0-48e9-b84d-34f210d2d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.880011 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b606e-d8c0-48e9-b84d-34f210d2d752 admin admin] PATH_INFO: `/v3/projects/334c2199091e40f2b001c38a4ff8e503/users/6653eb6e8a0c48cc83d8f2f6ea45f884/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.881943 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b606e-d8c0-48e9-b84d-34f210d2d752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334c2199091e40f2b001c38a4ff8e503, user_id=6653eb6e8a0c48cc83d8f2f6ea45f884, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:27.884596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b606e-d8c0-48e9-b84d-34f210d2d752 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:27.895146 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1391/2780] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:27 2022] PUT /identity/v3/projects/334c2199091e40f2b001c38a4ff8e503/users/6653eb6e8a0c48cc83d8f2f6ea45f884/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:27.906922 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751690f-1274-446d-a05c-34671339c049 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.907217 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751690f-1274-446d-a05c-34671339c049 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.907527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751690f-1274-446d-a05c-34671339c049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.933342 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b606e-d8c0-48e9-b84d-34f210d2d752 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:27.934645 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-a751690f-1274-446d-a05c-34671339c049 None None] MFA Rules not processed for user `6653eb6e8a0c48cc83d8f2f6ea45f884`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:27.935898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a751690f-1274-446d-a05c-34671339c049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:27.989258 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b606e-d8c0-48e9-b84d-34f210d2d752 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:27.992995 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:27.993636 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:27.993933 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:27.994222 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:27.996109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:28.004015 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1390/2781] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:28.015181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751690f-1274-446d-a05c-34671339c049 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:28.016635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-a751690f-1274-446d-a05c-34671339c049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:28.028898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751690f-1274-446d-a05c-34671339c049 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:28.032742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d5432-574c-43eb-be83-7b03d009dc74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:28.033371 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d5432-574c-43eb-be83-7b03d009dc74 service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:28.033648 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d5432-574c-43eb-be83-7b03d009dc74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:28.033920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d5432-574c-43eb-be83-7b03d009dc74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:28.042834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d5432-574c-43eb-be83-7b03d009dc74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:28.044321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d5432-574c-43eb-be83-7b03d009dc74 service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:28.053637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1391/2782] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:06:28.059777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:28.061161 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:28.071179 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1392/2783] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:28.099513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d5432-574c-43eb-be83-7b03d009dc74 service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:28.108689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d5432-574c-43eb-be83-7b03d009dc74 service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:28.112621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6c33-1f32-4062-9cdb-f29d91e46dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:28.113496 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6c33-1f32-4062-9cdb-f29d91e46dfd service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:28.113920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6c33-1f32-4062-9cdb-f29d91e46dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:28.114277 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6c33-1f32-4062-9cdb-f29d91e46dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:28.173635 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6c33-1f32-4062-9cdb-f29d91e46dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:28.175078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6c33-1f32-4062-9cdb-f29d91e46dfd service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:28.184379 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1392/2784] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:31.356515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:31.416114 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8cec-74be-4a40-980a-1aff7066bc80 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:31.420783 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:31.421647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:31.421930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:31.422203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] PATH_INFO: `/v3/users/77cd1c5dd3114aec8a1799c684a23807` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:31.423415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cd1c5dd3114aec8a1799c684a23807)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:31.425334 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:31.470800 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cd1c5dd3114aec8a1799c684a23807'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.479422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cd1c5dd3114aec8a1799c684a23807'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.489404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cd1c5dd3114aec8a1799c684a23807'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.490017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cd1c5dd3114aec8a1799c684a23807'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.501503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cd1c5dd3114aec8a1799c684a23807'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.507643 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1393/2785] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:31 2022] DELETE /identity/v3/users/77cd1c5dd3114aec8a1799c684a23807 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:31.512407 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e6953-f102-4193-95b5-33254acab0b9 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:31.512897 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e6953-f102-4193-95b5-33254acab0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:31.512997 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e6953-f102-4193-95b5-33254acab0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:31.530691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b44e6953-f102-4193-95b5-33254acab0b9 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:31.531920 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b44e6953-f102-4193-95b5-33254acab0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:31.588687 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1393/2786] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:31.598825 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:31.600316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:31.655548 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be5cc-0547-416e-89a9-0721b322c2a2 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:31.659157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:31.659840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:31.660122 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:31.660396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:31.669559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:31.670986 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:31.680466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1394/2787] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:31.875289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e6953-f102-4193-95b5-33254acab0b9 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:31.876714 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b44e6953-f102-4193-95b5-33254acab0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:31.888075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e6953-f102-4193-95b5-33254acab0b9 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:31.893116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:31.893978 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:31.894254 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:31.894527 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] PATH_INFO: `/v3/users/e773d4fecfa34819b2b6c8c597a4cf19` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:31.895725 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e773d4fecfa34819b2b6c8c597a4cf19)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:31.897613 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:31.940947 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:31.942530 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:31.946255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e773d4fecfa34819b2b6c8c597a4cf19'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.954615 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e773d4fecfa34819b2b6c8c597a4cf19'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.955348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e773d4fecfa34819b2b6c8c597a4cf19'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.957199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc72b7-689c-4129-884f-d5279291ca3a service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:31.962815 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:31.963813 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:31.963998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e773d4fecfa34819b2b6c8c597a4cf19'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.964119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:31.964349 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] PATH_INFO: `/v3/projects/ddb3a09405b440779fd4ad55ada40839` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:31.965028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-34aa268f-cd5d-4a16-affe-dcae7c3243a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e773d4fecfa34819b2b6c8c597a4cf19'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:31.965664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb3a09405b440779fd4ad55ada40839)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:31.967653 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:31.983042 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1394/2788] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:31 2022] DELETE /identity/v3/users/e773d4fecfa34819b2b6c8c597a4cf19 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:31.987382 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe6e8d-f19d-4e04-b453-92585ca2bb5d None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:31.987678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe6e8d-f19d-4e04-b453-92585ca2bb5d None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:31.987953 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe6e8d-f19d-4e04-b453-92585ca2bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.005292 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-1abe6e8d-f19d-4e04-b453-92585ca2bb5d None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:32.006572 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1abe6e8d-f19d-4e04-b453-92585ca2bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.014738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb3a09405b440779fd4ad55ada40839', 'request_id': 'req-bd997d85-d02a-48a0-a572-8e52a23e721d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.022068 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb3a09405b440779fd4ad55ada40839', 'request_id': 'req-bd997d85-d02a-48a0-a572-8e52a23e721d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.027486 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb3a09405b440779fd4ad55ada40839', 'request_id': 'req-bd997d85-d02a-48a0-a572-8e52a23e721d'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.038101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] The token cache is being invalidate because project ddb3a09405b440779fd4ad55ada40839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:32.038380 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.039119 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.040910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1395/2789] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:31 2022] DELETE /identity/v3/projects/ddb3a09405b440779fd4ad55ada40839 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:32.044426 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:32.046227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.065750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1395/2790] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:32.075370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe6e8d-f19d-4e04-b453-92585ca2bb5d None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:32.076809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-1abe6e8d-f19d-4e04-b453-92585ca2bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.108620 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd997d85-d02a-48a0-a572-8e52a23e721d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:32.113172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:32.114037 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.114312 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.114578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] PATH_INFO: `/v3/users/6653eb6e8a0c48cc83d8f2f6ea45f884` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.115785 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6653eb6e8a0c48cc83d8f2f6ea45f884)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:32.117704 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:32.134180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe6e8d-f19d-4e04-b453-92585ca2bb5d None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:32.138103 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:32.138823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.139107 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.139563 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.150676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:32.152262 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:32.162101 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1396/2791] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:06:32.163553 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6653eb6e8a0c48cc83d8f2f6ea45f884'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.171290 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6653eb6e8a0c48cc83d8f2f6ea45f884'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.178736 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6653eb6e8a0c48cc83d8f2f6ea45f884'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.179396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6653eb6e8a0c48cc83d8f2f6ea45f884'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.191852 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6653eb6e8a0c48cc83d8f2f6ea45f884'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.207323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1396/2792] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:32 2022] DELETE /identity/v3/users/6653eb6e8a0c48cc83d8f2f6ea45f884 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:32.467452 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:32.468935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.482175 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e2432-6af7-4e0e-bb24-db8a1d2a5229 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:32.513257 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:32.514769 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.551864 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:32.552750 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.553035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.553310 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] PATH_INFO: `/v3/projects/f515771460094d6693ae7f11845d2a38` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.554504 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f515771460094d6693ae7f11845d2a38)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:32.556449 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:32.582323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d342209-ebf0-4541-910e-931fc09aad12 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:32.587784 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:32.588650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.588936 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.589206 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] PATH_INFO: `/v3/projects/334c2199091e40f2b001c38a4ff8e503` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.590383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] RBAC: Authorizing `identity:delete_project(project_id=334c2199091e40f2b001c38a4ff8e503)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:32.593042 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:32.603508 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f515771460094d6693ae7f11845d2a38', 'request_id': 'req-37ba2752-e171-40ad-966a-c2843daaf5ac'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.609363 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f515771460094d6693ae7f11845d2a38', 'request_id': 'req-37ba2752-e171-40ad-966a-c2843daaf5ac'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.617682 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f515771460094d6693ae7f11845d2a38', 'request_id': 'req-37ba2752-e171-40ad-966a-c2843daaf5ac'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.629027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] The token cache is being invalidate because project f515771460094d6693ae7f11845d2a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:32.629264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.629915 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.631606 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1397/2793] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:32 2022] DELETE /identity/v3/projects/f515771460094d6693ae7f11845d2a38 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:32.635520 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:32.636810 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.643059 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334c2199091e40f2b001c38a4ff8e503', 'request_id': 'req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.650527 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334c2199091e40f2b001c38a4ff8e503', 'request_id': 'req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.656658 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334c2199091e40f2b001c38a4ff8e503', 'request_id': 'req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.667588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] The token cache is being invalidate because project 334c2199091e40f2b001c38a4ff8e503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:32.667878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.668539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-ab4a0edc-c9b3-47dc-95db-a0ab4ca3740e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.670861 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1397/2794] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:32 2022] DELETE /identity/v3/projects/334c2199091e40f2b001c38a4ff8e503 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:32.675384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c2fe5-ebba-4543-ab1c-2c99d1c07bc3 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.675673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c2fe5-ebba-4543-ab1c-2c99d1c07bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.675950 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c2fe5-ebba-4543-ab1c-2c99d1c07bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.693546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-206c2fe5-ebba-4543-ab1c-2c99d1c07bc3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:32.695045 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-206c2fe5-ebba-4543-ab1c-2c99d1c07bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.700513 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2752-e171-40ad-966a-c2843daaf5ac admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:32.752888 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1398/2795] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:32.758378 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:32.759268 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.759577 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.759852 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] PATH_INFO: `/v3/users/e1e36234d5a3449d8c6f83efa1c4c616` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.760506 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed3da-cb46-4d26-b5e5-41928bcd2634 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.760793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed3da-cb46-4d26-b5e5-41928bcd2634 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.761056 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e36234d5a3449d8c6f83efa1c4c616)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:32.761174 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed3da-cb46-4d26-b5e5-41928bcd2634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.762970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:32.778393 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-c51ed3da-cb46-4d26-b5e5-41928bcd2634 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:32.780156 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c51ed3da-cb46-4d26-b5e5-41928bcd2634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.788187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1399/2796] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:32.792253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed3da-cb46-4d26-b5e5-41928bcd2634 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:32.802859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed3da-cb46-4d26-b5e5-41928bcd2634 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:32.807644 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:32.808293 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.808574 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.808845 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] PATH_INFO: `/v3/domains` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.809083 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e36234d5a3449d8c6f83efa1c4c616'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.809568 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:32.809878 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:32.811572 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:32.816343 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e36234d5a3449d8c6f83efa1c4c616'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.817124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e36234d5a3449d8c6f83efa1c4c616'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.827895 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1400/2797] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 19:06:32.828087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e36234d5a3449d8c6f83efa1c4c616'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.828087 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e36234d5a3449d8c6f83efa1c4c616'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:32.828984 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:32.830635 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:32.843600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec2da3-dfd5-49ea-9aa2-44e07fc1a92e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:32.843900 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1398/2798] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:32 2022] DELETE /identity/v3/users/e1e36234d5a3449d8c6f83efa1c4c616 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:32.899050 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcc111-a992-4640-9f04-beb18257a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:32.899668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcc111-a992-4640-9f04-beb18257a9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:32.899949 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcc111-a992-4640-9f04-beb18257a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:32.900340 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcc111-a992-4640-9f04-beb18257a9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:32.901036 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcc111-a992-4640-9f04-beb18257a9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:32.902951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcc111-a992-4640-9f04-beb18257a9f1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:32.931449 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1401/2799] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:32 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:32.932759 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:32.943170 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404a9e0-fe58-4197-8cd1-9ac63dd035f8 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.001169 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbaa70-380b-463a-99b8-cf818b09672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.001852 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbaa70-380b-463a-99b8-cf818b09672a admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.002135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbaa70-380b-463a-99b8-cf818b09672a admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.002413 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbaa70-380b-463a-99b8-cf818b09672a admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.003230 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbaa70-380b-463a-99b8-cf818b09672a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.005259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbaa70-380b-463a-99b8-cf818b09672a admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.027337 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1399/2800] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:32 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:33.030188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcc111-a992-4640-9f04-beb18257a9f1 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.040318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcc111-a992-4640-9f04-beb18257a9f1 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.045018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d4f4-a528-4818-8fbc-f44e6fdb6f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.045677 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d4f4-a528-4818-8fbc-f44e6fdb6f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.045954 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d4f4-a528-4818-8fbc-f44e6fdb6f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.046223 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d4f4-a528-4818-8fbc-f44e6fdb6f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.046945 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085d4f4-a528-4818-8fbc-f44e6fdb6f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.048670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085d4f4-a528-4818-8fbc-f44e6fdb6f1f admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.061578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1402/2801] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:33.062779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbaa70-380b-463a-99b8-cf818b09672a admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.073000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbaa70-380b-463a-99b8-cf818b09672a admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.078144 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.078803 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.079109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.079412 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.080167 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.081754 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.092356 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1400/2802] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:33.096387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d4f4-a528-4818-8fbc-f44e6fdb6f1f admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.106446 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d4f4-a528-4818-8fbc-f44e6fdb6f1f admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.107532 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.109255 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.111748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca254665-c569-4a60-bb4b-cac9343f1d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.112950 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca254665-c569-4a60-bb4b-cac9343f1d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.113361 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca254665-c569-4a60-bb4b-cac9343f1d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.113780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca254665-c569-4a60-bb4b-cac9343f1d19 admin admin] PATH_INFO: `/v3/projects/863a9f6fb85d453e99f18ae8f4e79815/users/91e6271c16f148179460aee31adef3d5/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.125362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813e1a-7e96-4e95-8581-39960eb05b65 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.130436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.131359 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.131723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.131935 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] PATH_INFO: `/v3/projects/961a5996ea3a43669fbd8a049c7c6962` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.133117 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961a5996ea3a43669fbd8a049c7c6962)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.135035 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.138238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca254665-c569-4a60-bb4b-cac9343f1d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863a9f6fb85d453e99f18ae8f4e79815, user_id=91e6271c16f148179460aee31adef3d5, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.141429 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca254665-c569-4a60-bb4b-cac9343f1d19 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.155078 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1403/2803] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:33 2022] PUT /identity/v3/projects/863a9f6fb85d453e99f18ae8f4e79815/users/91e6271c16f148179460aee31adef3d5/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:33.165074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f35c-a07f-48c6-8926-bfd0b2181e18 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.165396 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f35c-a07f-48c6-8926-bfd0b2181e18 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.165793 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f35c-a07f-48c6-8926-bfd0b2181e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.182429 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961a5996ea3a43669fbd8a049c7c6962', 'request_id': 'req-9191e427-5d11-4967-a5f7-74c731df8a29'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.188259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961a5996ea3a43669fbd8a049c7c6962', 'request_id': 'req-9191e427-5d11-4967-a5f7-74c731df8a29'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.191754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-b461f35c-a07f-48c6-8926-bfd0b2181e18 None None] MFA Rules not processed for user `91e6271c16f148179460aee31adef3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:33.193090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b461f35c-a07f-48c6-8926-bfd0b2181e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.196506 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961a5996ea3a43669fbd8a049c7c6962', 'request_id': 'req-9191e427-5d11-4967-a5f7-74c731df8a29'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.209909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] The token cache is being invalidate because project 961a5996ea3a43669fbd8a049c7c6962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:33.210189 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.210905 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.212474 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1401/2804] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:33 2022] DELETE /identity/v3/projects/961a5996ea3a43669fbd8a049c7c6962 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:33.216294 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.217709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.274588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1404/2805] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:33.278997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f35c-a07f-48c6-8926-bfd0b2181e18 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.280347 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b461f35c-a07f-48c6-8926-bfd0b2181e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.286569 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191e427-5d11-4967-a5f7-74c731df8a29 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.291118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.292018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.292297 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.292561 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] PATH_INFO: `/v3/users/293a51f56ec04813af819873e4806e53` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.293203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f35c-a07f-48c6-8926-bfd0b2181e18 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.293734 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=293a51f56ec04813af819873e4806e53)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.295694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.297725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884827e-23c4-487b-88c7-1a1fe61bfd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.298363 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884827e-23c4-487b-88c7-1a1fe61bfd5e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.298645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884827e-23c4-487b-88c7-1a1fe61bfd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.298924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884827e-23c4-487b-88c7-1a1fe61bfd5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.299640 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884827e-23c4-487b-88c7-1a1fe61bfd5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.301550 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884827e-23c4-487b-88c7-1a1fe61bfd5e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.327887 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1405/2806] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:33 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:33.331688 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884827e-23c4-487b-88c7-1a1fe61bfd5e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.341234 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '293a51f56ec04813af819873e4806e53'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.348119 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '293a51f56ec04813af819873e4806e53'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.348795 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '293a51f56ec04813af819873e4806e53'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.356348 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '293a51f56ec04813af819873e4806e53'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.357459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '293a51f56ec04813af819873e4806e53'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.374946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1402/2807] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:33 2022] DELETE /identity/v3/users/293a51f56ec04813af819873e4806e53 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:33.392908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884827e-23c4-487b-88c7-1a1fe61bfd5e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.450310 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b025372-0a88-428e-a3d1-00e6413aaf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.451596 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b025372-0a88-428e-a3d1-00e6413aaf97 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.451881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b025372-0a88-428e-a3d1-00e6413aaf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.452153 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b025372-0a88-428e-a3d1-00e6413aaf97 admin admin] PATH_INFO: `/v3/users` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.452837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b025372-0a88-428e-a3d1-00e6413aaf97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.454775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b025372-0a88-428e-a3d1-00e6413aaf97 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.474487 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1406/2808] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:33 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:33.478261 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.479742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.492983 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f02d1-6a00-492c-8f23-859b90e29eb0 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.497640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8e35-670f-45b4-98ab-9364f60885a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.498843 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8e35-670f-45b4-98ab-9364f60885a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.499124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8e35-670f-45b4-98ab-9364f60885a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.499424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8e35-670f-45b4-98ab-9364f60885a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.500200 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8e35-670f-45b4-98ab-9364f60885a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.501792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8e35-670f-45b4-98ab-9364f60885a2 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.512126 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1403/2809] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:33.516717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b025372-0a88-428e-a3d1-00e6413aaf97 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.527920 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b025372-0a88-428e-a3d1-00e6413aaf97 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.533079 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.534002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.534292 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.534600 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] PATH_INFO: `/v3/projects/591366e4ba2e4a46b1871a629af93d37/users/29b14148181a486bbb198ff29abdbf8e/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.550422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591366e4ba2e4a46b1871a629af93d37, user_id=29b14148181a486bbb198ff29abdbf8e, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.553133 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.566951 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1407/2810] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:33 2022] PUT /identity/v3/projects/591366e4ba2e4a46b1871a629af93d37/users/29b14148181a486bbb198ff29abdbf8e/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:33.571210 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8e35-670f-45b4-98ab-9364f60885a2 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.581233 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8e35-670f-45b4-98ab-9364f60885a2 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.641250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.641436 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562760-1d8c-403b-836c-0efcf8fa1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.641994 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562760-1d8c-403b-836c-0efcf8fa1db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.642280 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562760-1d8c-403b-836c-0efcf8fa1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.642543 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562760-1d8c-403b-836c-0efcf8fa1db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.643141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.643362 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01562760-1d8c-403b-836c-0efcf8fa1db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.644916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01562760-1d8c-403b-836c-0efcf8fa1db4 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.658780 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1404/2811] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:33.658953 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cff298-e8ee-433b-8d5a-60307a94f614 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.660372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562760-1d8c-403b-836c-0efcf8fa1db4 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.662235 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.663104 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.663528 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.663808 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] PATH_INFO: `/v3/projects/64bb56fc1c75428b9d83ba93c002d7e7` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.665004 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64bb56fc1c75428b9d83ba93c002d7e7)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.667018 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.671879 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562760-1d8c-403b-836c-0efcf8fa1db4 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.676473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a323-c66b-4f5a-8c40-35fdb11f0a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.677385 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a323-c66b-4f5a-8c40-35fdb11f0a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.677661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a323-c66b-4f5a-8c40-35fdb11f0a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.678143 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a323-c66b-4f5a-8c40-35fdb11f0a74 admin admin] PATH_INFO: `/v3/projects/591366e4ba2e4a46b1871a629af93d37/users/29b14148181a486bbb198ff29abdbf8e/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.680018 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750a323-c66b-4f5a-8c40-35fdb11f0a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591366e4ba2e4a46b1871a629af93d37, user_id=29b14148181a486bbb198ff29abdbf8e, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.682650 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750a323-c66b-4f5a-8c40-35fdb11f0a74 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.694477 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1405/2812] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:33 2022] PUT /identity/v3/projects/591366e4ba2e4a46b1871a629af93d37/users/29b14148181a486bbb198ff29abdbf8e/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:33.705970 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d5946-e9cf-449d-8844-0e71a48615a1 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.706179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d5946-e9cf-449d-8844-0e71a48615a1 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.706455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d5946-e9cf-449d-8844-0e71a48615a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.715722 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64bb56fc1c75428b9d83ba93c002d7e7', 'request_id': 'req-8120553e-d164-4887-b63c-8822f99ba6d4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.725987 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64bb56fc1c75428b9d83ba93c002d7e7', 'request_id': 'req-8120553e-d164-4887-b63c-8822f99ba6d4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.731725 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64bb56fc1c75428b9d83ba93c002d7e7', 'request_id': 'req-8120553e-d164-4887-b63c-8822f99ba6d4'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.734886 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-bb3d5946-e9cf-449d-8844-0e71a48615a1 None None] MFA Rules not processed for user `29b14148181a486bbb198ff29abdbf8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:33.736131 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bb3d5946-e9cf-449d-8844-0e71a48615a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.743428 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] The token cache is being invalidate because project 64bb56fc1c75428b9d83ba93c002d7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:33.743718 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.744357 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-8120553e-d164-4887-b63c-8822f99ba6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:33.745919 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1408/2813] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:33 2022] DELETE /identity/v3/projects/64bb56fc1c75428b9d83ba93c002d7e7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:33.751099 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459d3a7-1a84-4d36-8b5e-d2d0defb64d4 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.751404 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459d3a7-1a84-4d36-8b5e-d2d0defb64d4 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.751673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459d3a7-1a84-4d36-8b5e-d2d0defb64d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.769328 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7459d3a7-1a84-4d36-8b5e-d2d0defb64d4 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:33.770539 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7459d3a7-1a84-4d36-8b5e-d2d0defb64d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.806888 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1406/2814] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:33.817881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d5946-e9cf-449d-8844-0e71a48615a1 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.819522 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-bb3d5946-e9cf-449d-8844-0e71a48615a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.840101 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1409/2815] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:33.886861 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d5946-e9cf-449d-8844-0e71a48615a1 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.890592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806cc0c-f6ec-4b04-aabf-a4a03c8d625a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.891250 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806cc0c-f6ec-4b04-aabf-a4a03c8d625a service cinder] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.891564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806cc0c-f6ec-4b04-aabf-a4a03c8d625a service cinder] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.891837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806cc0c-f6ec-4b04-aabf-a4a03c8d625a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.895027 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec1fe-62ec-4938-a735-db8882c3f358 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.895369 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec1fe-62ec-4938-a735-db8882c3f358 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.895645 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec1fe-62ec-4938-a735-db8882c3f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.902074 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806cc0c-f6ec-4b04-aabf-a4a03c8d625a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.903603 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806cc0c-f6ec-4b04-aabf-a4a03c8d625a service cinder] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.913179 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1407/2816] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:06:33.913515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-02fec1fe-62ec-4938-a735-db8882c3f358 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:33.914787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-02fec1fe-62ec-4938-a735-db8882c3f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:33.923455 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1410/2817] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:33.927620 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806cc0c-f6ec-4b04-aabf-a4a03c8d625a service cinder] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.938538 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806cc0c-f6ec-4b04-aabf-a4a03c8d625a service cinder] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.943549 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.944463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.944742 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.945013 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.945727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:33.946033 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.947740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:33.959372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1408/2818] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:06:33.963899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fec1fe-62ec-4938-a735-db8882c3f358 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:33.973607 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fec1fe-62ec-4938-a735-db8882c3f358 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:33.978284 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68ab05-3665-4946-b55c-4e14fffc6b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:33.978927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ab05-3665-4946-b55c-4e14fffc6b15 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:33.979209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ab05-3665-4946-b55c-4e14fffc6b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:33.979512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ab05-3665-4946-b55c-4e14fffc6b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:33.980207 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68ab05-3665-4946-b55c-4e14fffc6b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:33.982168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68ab05-3665-4946-b55c-4e14fffc6b15 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:34.007670 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1411/2819] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:33 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:34.011749 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:34.022151 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66000b46-9950-4b43-affd-b28b372cb55b admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:34.080387 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5580bd-0d81-470a-8cf3-0e1d238b69ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:34.081057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5580bd-0d81-470a-8cf3-0e1d238b69ba admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.081331 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5580bd-0d81-470a-8cf3-0e1d238b69ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.081597 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5580bd-0d81-470a-8cf3-0e1d238b69ba admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.082272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5580bd-0d81-470a-8cf3-0e1d238b69ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:34.084202 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5580bd-0d81-470a-8cf3-0e1d238b69ba admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:34.108308 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1409/2820] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:34 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:34.109664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68ab05-3665-4946-b55c-4e14fffc6b15 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:34.119787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68ab05-3665-4946-b55c-4e14fffc6b15 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:34.124454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f17e-9b2d-481d-9f59-ddf94173c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:34.125107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f17e-9b2d-481d-9f59-ddf94173c09d admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.125390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f17e-9b2d-481d-9f59-ddf94173c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.125663 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f17e-9b2d-481d-9f59-ddf94173c09d admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.126385 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3f17e-9b2d-481d-9f59-ddf94173c09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:34.128023 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3f17e-9b2d-481d-9f59-ddf94173c09d admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:34.138660 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1412/2821] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:34.142692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5580bd-0d81-470a-8cf3-0e1d238b69ba admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:34.152473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5580bd-0d81-470a-8cf3-0e1d238b69ba admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:34.157761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d2e79-e434-4f05-a39d-81b04226371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:34.158426 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d2e79-e434-4f05-a39d-81b04226371e admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.158715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d2e79-e434-4f05-a39d-81b04226371e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.158991 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d2e79-e434-4f05-a39d-81b04226371e admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.159760 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d2e79-e434-4f05-a39d-81b04226371e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:34.161431 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d2e79-e434-4f05-a39d-81b04226371e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:34.174840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1410/2822] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:34.176391 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f17e-9b2d-481d-9f59-ddf94173c09d admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:34.186345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f17e-9b2d-481d-9f59-ddf94173c09d admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:34.191003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:34.191930 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.192208 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.192481 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] PATH_INFO: `/v3/projects/6d43929ef2a74d3fb50580db2b83d868/users/36dbb1e903f24becaede7f26b06845e8/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.209788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d43929ef2a74d3fb50580db2b83d868, user_id=36dbb1e903f24becaede7f26b06845e8, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:34.212511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:34.226532 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1413/2823] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:34 2022] PUT /identity/v3/projects/6d43929ef2a74d3fb50580db2b83d868/users/36dbb1e903f24becaede7f26b06845e8/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:34.231744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b875f3-9e5e-46d5-9dd8-42b66e0ecf3f None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.232038 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b875f3-9e5e-46d5-9dd8-42b66e0ecf3f None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.232898 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b875f3-9e5e-46d5-9dd8-42b66e0ecf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.250424 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-91b875f3-9e5e-46d5-9dd8-42b66e0ecf3f None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:34.251728 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-91b875f3-9e5e-46d5-9dd8-42b66e0ecf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:34.312122 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1411/2824] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:34.321924 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:34.323672 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:34.385537 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc295-001f-45f0-a8f1-d7ce229e96a2 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:34.389646 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f48c3-1683-4276-a06b-7de5e78e7656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:34.390323 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f48c3-1683-4276-a06b-7de5e78e7656 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.390591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f48c3-1683-4276-a06b-7de5e78e7656 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.390867 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f48c3-1683-4276-a06b-7de5e78e7656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.399686 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f48c3-1683-4276-a06b-7de5e78e7656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:34.401112 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f48c3-1683-4276-a06b-7de5e78e7656 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:34.411469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1414/2825] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:34.434701 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b875f3-9e5e-46d5-9dd8-42b66e0ecf3f None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:34.436692 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-91b875f3-9e5e-46d5-9dd8-42b66e0ecf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:34.448721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b875f3-9e5e-46d5-9dd8-42b66e0ecf3f None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:34.453683 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:34.454537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.454809 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.455075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] PATH_INFO: `/v3/users/91e6271c16f148179460aee31adef3d5` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.456301 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e6271c16f148179460aee31adef3d5)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:34.458181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:34.503676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e6271c16f148179460aee31adef3d5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:34.510637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e6271c16f148179460aee31adef3d5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:34.511332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e6271c16f148179460aee31adef3d5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:34.519552 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e6271c16f148179460aee31adef3d5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:34.520165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e6271c16f148179460aee31adef3d5'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:34.539364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1412/2826] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:34 2022] DELETE /identity/v3/users/91e6271c16f148179460aee31adef3d5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:34.544172 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7dd53-3c57-41c3-8751-b897e49c450a None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.544696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7dd53-3c57-41c3-8751-b897e49c450a None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.544856 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7dd53-3c57-41c3-8751-b897e49c450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.563581 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f5f7dd53-3c57-41c3-8751-b897e49c450a None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:34.565077 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f5f7dd53-3c57-41c3-8751-b897e49c450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:34.628871 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1415/2827] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:34.639899 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:34.641317 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:34.703909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90ac43-1a48-40da-9f9b-8c7b48001499 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:34.708980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:34.709689 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:34.710116 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:34.710427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:34.723929 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:34.725418 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:34.736290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1413/2828] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:35.115052 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69de4-aa83-4f4c-bc89-5e2523a7f922 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:35.115515 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69de4-aa83-4f4c-bc89-5e2523a7f922 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:35.115859 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69de4-aa83-4f4c-bc89-5e2523a7f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:35.144989 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-d9e69de4-aa83-4f4c-bc89-5e2523a7f922 None None] MFA Rules not processed for user `36dbb1e903f24becaede7f26b06845e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:35.146210 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d9e69de4-aa83-4f4c-bc89-5e2523a7f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:35.185394 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:35.187137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:35.202158 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648270-3dcc-4e0a-a475-3ca2275e5e94 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:35.212176 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:35.213694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:35.213694 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:35.213941 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] PATH_INFO: `/v3/projects/863a9f6fb85d453e99f18ae8f4e79815` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:35.217223 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863a9f6fb85d453e99f18ae8f4e79815)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:35.219075 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:35.230410 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1416/2829] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:35.241141 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e69de4-aa83-4f4c-bc89-5e2523a7f922 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:35.242687 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-d9e69de4-aa83-4f4c-bc89-5e2523a7f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:35.290715 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863a9f6fb85d453e99f18ae8f4e79815', 'request_id': 'req-6db4c72b-4104-4afa-977f-3a40efc56f95'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.296520 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863a9f6fb85d453e99f18ae8f4e79815', 'request_id': 'req-6db4c72b-4104-4afa-977f-3a40efc56f95'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.305248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863a9f6fb85d453e99f18ae8f4e79815', 'request_id': 'req-6db4c72b-4104-4afa-977f-3a40efc56f95'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.312057 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e69de4-aa83-4f4c-bc89-5e2523a7f922 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:35.317078 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] The token cache is being invalidate because project 863a9f6fb85d453e99f18ae8f4e79815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:35.317490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.318211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.320460 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1414/2830] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:35 2022] DELETE /identity/v3/projects/863a9f6fb85d453e99f18ae8f4e79815 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:35.324520 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:35.326637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:35.363777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:35.364432 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:35.364707 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:35.364977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:35.366744 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:35.389744 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4c72b-4104-4afa-977f-3a40efc56f95 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:35.394445 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:35.395324 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:35.395616 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:35.395890 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] PATH_INFO: `/v3/users/29b14148181a486bbb198ff29abdbf8e` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:35.397088 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b14148181a486bbb198ff29abdbf8e)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:35.399001 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:35.426187 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:35.427723 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:35.437961 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1417/2831] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:35.452162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b14148181a486bbb198ff29abdbf8e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.459278 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b14148181a486bbb198ff29abdbf8e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.460404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b14148181a486bbb198ff29abdbf8e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.469091 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b14148181a486bbb198ff29abdbf8e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.469981 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-60b04482-91a7-48dd-a1c7-31e3ba71aa29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b14148181a486bbb198ff29abdbf8e'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.489195 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1415/2832] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:35 2022] DELETE /identity/v3/users/29b14148181a486bbb198ff29abdbf8e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:35.770940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:35.784879 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687f1d-df54-44d2-acc9-aa835a9c179c service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:35.847013 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:35.847830 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:35.848109 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:35.848379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] PATH_INFO: `/v3/projects/591366e4ba2e4a46b1871a629af93d37` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:35.849546 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591366e4ba2e4a46b1871a629af93d37)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:35.851500 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:35.896093 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591366e4ba2e4a46b1871a629af93d37', 'request_id': 'req-05fb67e7-9269-4370-8ac1-5641abf6ed16'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.903127 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591366e4ba2e4a46b1871a629af93d37', 'request_id': 'req-05fb67e7-9269-4370-8ac1-5641abf6ed16'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.908383 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591366e4ba2e4a46b1871a629af93d37', 'request_id': 'req-05fb67e7-9269-4370-8ac1-5641abf6ed16'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.918740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] The token cache is being invalidate because project 591366e4ba2e4a46b1871a629af93d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:35.919017 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.920229 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-05fb67e7-9269-4370-8ac1-5641abf6ed16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:35.921812 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1418/2833] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:35 2022] DELETE /identity/v3/projects/591366e4ba2e4a46b1871a629af93d37 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:35.926985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ef5d-393c-4f02-9b5e-26f71db1e5b3 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:35.927495 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ef5d-393c-4f02-9b5e-26f71db1e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:35.927592 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ef5d-393c-4f02-9b5e-26f71db1e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:35.951408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-b457ef5d-393c-4f02-9b5e-26f71db1e5b3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:35.952590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-b457ef5d-393c-4f02-9b5e-26f71db1e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:36.008321 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1416/2834] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:36.016088 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716aca4-ccb3-4425-9347-5e774b1d6eef None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.016381 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716aca4-ccb3-4425-9347-5e774b1d6eef None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.016680 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716aca4-ccb3-4425-9347-5e774b1d6eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.034291 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-f716aca4-ccb3-4425-9347-5e774b1d6eef None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:36.035511 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f716aca4-ccb3-4425-9347-5e774b1d6eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:36.043374 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1419/2835] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:36.047891 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ef5d-393c-4f02-9b5e-26f71db1e5b3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.057162 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ef5d-393c-4f02-9b5e-26f71db1e5b3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.062163 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.062796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.063072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.063370 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.064157 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:36.064459 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.066027 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.077303 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1417/2836] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:06:36.081436 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716aca4-ccb3-4425-9347-5e774b1d6eef None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.090700 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716aca4-ccb3-4425-9347-5e774b1d6eef None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.095435 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a18a7-9e8b-486b-9d1e-7ca206960b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.096090 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a18a7-9e8b-486b-9d1e-7ca206960b70 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.096373 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a18a7-9e8b-486b-9d1e-7ca206960b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.096650 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a18a7-9e8b-486b-9d1e-7ca206960b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.097397 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a18a7-9e8b-486b-9d1e-7ca206960b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.099251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a18a7-9e8b-486b-9d1e-7ca206960b70 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.124960 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1420/2837] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:36 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:36.129037 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.138960 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e756b4-199a-46c2-a5d6-1c012c1738e6 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.197740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308663e4-57f1-45dd-ab5b-e0d7a3dd91b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.198425 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308663e4-57f1-45dd-ab5b-e0d7a3dd91b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.198761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308663e4-57f1-45dd-ab5b-e0d7a3dd91b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.199079 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308663e4-57f1-45dd-ab5b-e0d7a3dd91b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.199946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308663e4-57f1-45dd-ab5b-e0d7a3dd91b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.202312 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308663e4-57f1-45dd-ab5b-e0d7a3dd91b7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.222885 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1418/2838] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:36 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:36.227055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a18a7-9e8b-486b-9d1e-7ca206960b70 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.237902 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a18a7-9e8b-486b-9d1e-7ca206960b70 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.242504 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15a96-de51-439a-a02d-2eb73f94d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.243188 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15a96-de51-439a-a02d-2eb73f94d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.243510 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15a96-de51-439a-a02d-2eb73f94d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.243787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15a96-de51-439a-a02d-2eb73f94d5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.244509 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf15a96-de51-439a-a02d-2eb73f94d5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.246168 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf15a96-de51-439a-a02d-2eb73f94d5f9 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.256388 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1421/2839] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:36.260160 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308663e4-57f1-45dd-ab5b-e0d7a3dd91b7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.269880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308663e4-57f1-45dd-ab5b-e0d7a3dd91b7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.274473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fee980-f42c-4bbe-91f2-1a3434a73f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.275124 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fee980-f42c-4bbe-91f2-1a3434a73f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.275440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fee980-f42c-4bbe-91f2-1a3434a73f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.275719 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fee980-f42c-4bbe-91f2-1a3434a73f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.276463 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fee980-f42c-4bbe-91f2-1a3434a73f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.278014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fee980-f42c-4bbe-91f2-1a3434a73f23 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.288289 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1419/2840] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 19:06:36.292250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15a96-de51-439a-a02d-2eb73f94d5f9 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.302589 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15a96-de51-439a-a02d-2eb73f94d5f9 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.307193 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae7888-04a3-41d7-ad9b-bd44140f11da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.308097 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae7888-04a3-41d7-ad9b-bd44140f11da admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.308386 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae7888-04a3-41d7-ad9b-bd44140f11da admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.308664 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae7888-04a3-41d7-ad9b-bd44140f11da admin admin] PATH_INFO: `/v3/projects/013f730832bc411dbd5b5cf83ff2e0c7/users/38f95339f3124393a4415022e2a26321/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.323201 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae7888-04a3-41d7-ad9b-bd44140f11da admin admin] RBAC: Authorizing `identity:create_grant(project_id=013f730832bc411dbd5b5cf83ff2e0c7, user_id=38f95339f3124393a4415022e2a26321, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.325909 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae7888-04a3-41d7-ad9b-bd44140f11da admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.338194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1422/2841] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:36 2022] PUT /identity/v3/projects/013f730832bc411dbd5b5cf83ff2e0c7/users/38f95339f3124393a4415022e2a26321/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:36.350036 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202a92-6554-4909-a8f1-ab0787f21a25 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.350259 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202a92-6554-4909-a8f1-ab0787f21a25 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.350535 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202a92-6554-4909-a8f1-ab0787f21a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.376636 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ab202a92-6554-4909-a8f1-ab0787f21a25 None None] MFA Rules not processed for user `38f95339f3124393a4415022e2a26321`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:36.377824 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ab202a92-6554-4909-a8f1-ab0787f21a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:36.438814 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1420/2842] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:36.443317 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae7888-04a3-41d7-ad9b-bd44140f11da admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.503994 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae7888-04a3-41d7-ad9b-bd44140f11da admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.508862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0760c-6ac4-42bb-907f-e1901b74e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.509520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0760c-6ac4-42bb-907f-e1901b74e83e admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.509807 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0760c-6ac4-42bb-907f-e1901b74e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.510083 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0760c-6ac4-42bb-907f-e1901b74e83e admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.510775 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0760c-6ac4-42bb-907f-e1901b74e83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.512715 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0760c-6ac4-42bb-907f-e1901b74e83e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.537668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1423/2843] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:36 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:36.541688 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202a92-6554-4909-a8f1-ab0787f21a25 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.552840 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202a92-6554-4909-a8f1-ab0787f21a25 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.609427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38953868-6aef-4921-896b-0f83249177b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.610020 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953868-6aef-4921-896b-0f83249177b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.610304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953868-6aef-4921-896b-0f83249177b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.610581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953868-6aef-4921-896b-0f83249177b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.611265 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38953868-6aef-4921-896b-0f83249177b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.613213 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38953868-6aef-4921-896b-0f83249177b7 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.632959 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1421/2844] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:36 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 19:06:36.636910 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0760c-6ac4-42bb-907f-e1901b74e83e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.647776 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0760c-6ac4-42bb-907f-e1901b74e83e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.652469 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae25106-c8d8-48de-ad8f-016466ca38c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.653155 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25106-c8d8-48de-ad8f-016466ca38c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.653439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25106-c8d8-48de-ad8f-016466ca38c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.653716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25106-c8d8-48de-ad8f-016466ca38c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.655002 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae25106-c8d8-48de-ad8f-016466ca38c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.656673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae25106-c8d8-48de-ad8f-016466ca38c6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.666925 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1424/2845] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:36.670820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38953868-6aef-4921-896b-0f83249177b7 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.680611 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38953868-6aef-4921-896b-0f83249177b7 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.685314 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bb090-3538-475c-ac54-9cf83ae5f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.686180 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bb090-3538-475c-ac54-9cf83ae5f67c admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.686455 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bb090-3538-475c-ac54-9cf83ae5f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.686721 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bb090-3538-475c-ac54-9cf83ae5f67c admin admin] PATH_INFO: `/v3/projects/38d064825a4f4f7f9ee64a404f0573f3/users/1e30df609f8a4bb6a9cfd047c5bc1b0c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.701881 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bb090-3538-475c-ac54-9cf83ae5f67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d064825a4f4f7f9ee64a404f0573f3, user_id=1e30df609f8a4bb6a9cfd047c5bc1b0c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.704621 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bb090-3538-475c-ac54-9cf83ae5f67c admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.717837 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1422/2846] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:36 2022] PUT /identity/v3/projects/38d064825a4f4f7f9ee64a404f0573f3/users/1e30df609f8a4bb6a9cfd047c5bc1b0c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 19:06:36.721809 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae25106-c8d8-48de-ad8f-016466ca38c6 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.732009 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae25106-c8d8-48de-ad8f-016466ca38c6 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.787941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4742-21be-452e-ae38-9606ed703043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.788622 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4742-21be-452e-ae38-9606ed703043 admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.788901 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4742-21be-452e-ae38-9606ed703043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.789175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4742-21be-452e-ae38-9606ed703043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.789899 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f4742-21be-452e-ae38-9606ed703043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.791516 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f4742-21be-452e-ae38-9606ed703043 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.804421 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1425/2847] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:36.805581 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bb090-3538-475c-ac54-9cf83ae5f67c admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.808202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe9ca6-6143-4e26-849c-67ae0d73e37e None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.808564 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe9ca6-6143-4e26-849c-67ae0d73e37e None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.808851 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe9ca6-6143-4e26-849c-67ae0d73e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.816161 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bb090-3538-475c-ac54-9cf83ae5f67c admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:36.821284 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1b0e4-7b2d-4d8a-9c5a-0fad83a16055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:36.822183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1b0e4-7b2d-4d8a-9c5a-0fad83a16055 admin admin] REQUEST_METHOD: `PUT` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.822458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1b0e4-7b2d-4d8a-9c5a-0fad83a16055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.822751 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1b0e4-7b2d-4d8a-9c5a-0fad83a16055 admin admin] PATH_INFO: `/v3/projects/38d064825a4f4f7f9ee64a404f0573f3/users/1e30df609f8a4bb6a9cfd047c5bc1b0c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.824774 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1b0e4-7b2d-4d8a-9c5a-0fad83a16055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d064825a4f4f7f9ee64a404f0573f3, user_id=1e30df609f8a4bb6a9cfd047c5bc1b0c, role_id=7e1f5b10c66c4b2c91ad4544ab6fc743)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:36.827117 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-21fe9ca6-6143-4e26-849c-67ae0d73e37e None None] MFA Rules not processed for user `36dbb1e903f24becaede7f26b06845e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:36.828307 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1b0e4-7b2d-4d8a-9c5a-0fad83a16055 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:36.828526 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-21fe9ca6-6143-4e26-849c-67ae0d73e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:36.838758 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1423/2848] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:36 2022] PUT /identity/v3/projects/38d064825a4f4f7f9ee64a404f0573f3/users/1e30df609f8a4bb6a9cfd047c5bc1b0c/roles/7e1f5b10c66c4b2c91ad4544ab6fc743 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:36.849487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97fa1c-6a95-492e-85c6-0ee72188c848 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:36.849771 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97fa1c-6a95-492e-85c6-0ee72188c848 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:36.850050 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97fa1c-6a95-492e-85c6-0ee72188c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:36.877109 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-ce97fa1c-6a95-492e-85c6-0ee72188c848 None None] MFA Rules not processed for user `1e30df609f8a4bb6a9cfd047c5bc1b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:36.878241 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-ce97fa1c-6a95-492e-85c6-0ee72188c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:36.885990 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1426/2849] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:36.949787 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1424/2850] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 19:06:36.961203 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe9ca6-6143-4e26-849c-67ae0d73e37e None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:36.962602 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-21fe9ca6-6143-4e26-849c-67ae0d73e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:37.022275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe9ca6-6143-4e26-849c-67ae0d73e37e None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:37.071145 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec701f-80f9-4eeb-a13f-020d2f713561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:37.071823 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec701f-80f9-4eeb-a13f-020d2f713561 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:37.072102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec701f-80f9-4eeb-a13f-020d2f713561 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:37.072382 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec701f-80f9-4eeb-a13f-020d2f713561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:37.127319 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec701f-80f9-4eeb-a13f-020d2f713561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:37.128696 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec701f-80f9-4eeb-a13f-020d2f713561 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:37.138325 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1427/2851] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:39.690880 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97fa1c-6a95-492e-85c6-0ee72188c848 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:39.754073 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97fa1c-6a95-492e-85c6-0ee72188c848 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:39.759533 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:39.760404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:39.760676 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:39.760946 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] PATH_INFO: `/v3/users/38f95339f3124393a4415022e2a26321` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:39.762139 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f95339f3124393a4415022e2a26321)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:39.764639 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:39.810686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f95339f3124393a4415022e2a26321'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:39.817487 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f95339f3124393a4415022e2a26321'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:39.818159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f95339f3124393a4415022e2a26321'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:39.826668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f95339f3124393a4415022e2a26321'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:39.827862 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f95339f3124393a4415022e2a26321'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:39.846583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1425/2852] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:39 2022] DELETE /identity/v3/users/38f95339f3124393a4415022e2a26321 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:39.850881 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aad152-3106-4818-8b5b-b1a289af692b None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:39.851402 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aad152-3106-4818-8b5b-b1a289af692b None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:39.851538 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aad152-3106-4818-8b5b-b1a289af692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:39.869592 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-e4aad152-3106-4818-8b5b-b1a289af692b None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:39.871717 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e4aad152-3106-4818-8b5b-b1a289af692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:39.937407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1428/2853] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:39.947607 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:39.949405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:40.006290 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b287a0-f64b-44cf-8b94-58ca8fa0e61e admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:40.009916 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e930-9df4-4230-8d8e-afdb032d2f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:40.010558 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e930-9df4-4230-8d8e-afdb032d2f18 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:40.010834 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e930-9df4-4230-8d8e-afdb032d2f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:40.011104 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e930-9df4-4230-8d8e-afdb032d2f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:40.020792 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777e930-9df4-4230-8d8e-afdb032d2f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:40.022222 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777e930-9df4-4230-8d8e-afdb032d2f18 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:40.031999 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1426/2854] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:06:40.407668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aad152-3106-4818-8b5b-b1a289af692b None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:40.409238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-e4aad152-3106-4818-8b5b-b1a289af692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:40.421503 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aad152-3106-4818-8b5b-b1a289af692b None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:40.426408 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:40.427330 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:40.427610 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:40.427883 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] PATH_INFO: `/v3/projects/013f730832bc411dbd5b5cf83ff2e0c7` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:40.429135 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] RBAC: Authorizing `identity:delete_project(project_id=013f730832bc411dbd5b5cf83ff2e0c7)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:40.431086 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:40.490194 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013f730832bc411dbd5b5cf83ff2e0c7', 'request_id': 'req-dff96b21-5a95-4569-b515-4e3ebefd008e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.501043 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013f730832bc411dbd5b5cf83ff2e0c7', 'request_id': 'req-dff96b21-5a95-4569-b515-4e3ebefd008e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.506903 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013f730832bc411dbd5b5cf83ff2e0c7', 'request_id': 'req-dff96b21-5a95-4569-b515-4e3ebefd008e'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.518073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] The token cache is being invalidate because project 013f730832bc411dbd5b5cf83ff2e0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:40.518268 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.518927 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.520513 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1429/2855] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:40 2022] DELETE /identity/v3/projects/013f730832bc411dbd5b5cf83ff2e0c7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:40.524537 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e930-9df4-4230-8d8e-afdb032d2f18 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:40.534072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e930-9df4-4230-8d8e-afdb032d2f18 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:40.593291 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:40.594159 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:40.594438 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:40.594709 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] PATH_INFO: `/v3/users/1e30df609f8a4bb6a9cfd047c5bc1b0c` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:40.595918 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e30df609f8a4bb6a9cfd047c5bc1b0c)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:40.597823 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:40.648408 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e30df609f8a4bb6a9cfd047c5bc1b0c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.655114 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e30df609f8a4bb6a9cfd047c5bc1b0c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.655972 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e30df609f8a4bb6a9cfd047c5bc1b0c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.663133 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e30df609f8a4bb6a9cfd047c5bc1b0c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.663789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-d52d3516-5bd0-4b79-ab9e-27c0f6250cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e30df609f8a4bb6a9cfd047c5bc1b0c'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:40.681304 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1427/2856] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:06:40 2022] DELETE /identity/v3/users/1e30df609f8a4bb6a9cfd047c5bc1b0c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:40.955482 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:40.956940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:40.970489 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff96b21-5a95-4569-b515-4e3ebefd008e admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:41.026673 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:41.027499 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.027780 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.028073 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] PATH_INFO: `/v3/projects/38d064825a4f4f7f9ee64a404f0573f3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.029781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d064825a4f4f7f9ee64a404f0573f3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:41.031788 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:41.080292 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d064825a4f4f7f9ee64a404f0573f3', 'request_id': 'req-d32204f2-2312-4239-bbb2-e25035be6ceb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:41.087341 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d064825a4f4f7f9ee64a404f0573f3', 'request_id': 'req-d32204f2-2312-4239-bbb2-e25035be6ceb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:41.093379 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d064825a4f4f7f9ee64a404f0573f3', 'request_id': 'req-d32204f2-2312-4239-bbb2-e25035be6ceb'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:41.104022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] The token cache is being invalidate because project 38d064825a4f4f7f9ee64a404f0573f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:06:41.104307 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:41.104932 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d32204f2-2312-4239-bbb2-e25035be6ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:06:41.106494 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1430/2857] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:06:40 2022] DELETE /identity/v3/projects/38d064825a4f4f7f9ee64a404f0573f3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:41.112718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85901-cb24-4a3b-8e65-73d452e3dbb3 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.113218 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85901-cb24-4a3b-8e65-73d452e3dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.113319 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85901-cb24-4a3b-8e65-73d452e3dbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.130181 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-91e85901-cb24-4a3b-8e65-73d452e3dbb3 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:41.131390 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-91e85901-cb24-4a3b-8e65-73d452e3dbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:41.189185 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1428/2858] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:41.197520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeab74-dea5-4082-bd74-50ec7942dfe2 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.197814 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeab74-dea5-4082-bd74-50ec7942dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.198108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeab74-dea5-4082-bd74-50ec7942dfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.217352 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-bebeab74-dea5-4082-bd74-50ec7942dfe2 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:41.218578 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-bebeab74-dea5-4082-bd74-50ec7942dfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:41.226520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1431/2859] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:41.231072 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85901-cb24-4a3b-8e65-73d452e3dbb3 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:41.240844 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85901-cb24-4a3b-8e65-73d452e3dbb3 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:41.245427 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:41.246066 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.246344 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.246614 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.247358 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 19:06:41.247665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:41.249239 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:41.260724 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1429/2860] 10.222.0.93 () {58 vars in 1152 bytes} [Wed May 11 19:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 19:06:41.265695 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeab74-dea5-4082-bd74-50ec7942dfe2 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:41.274698 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeab74-dea5-4082-bd74-50ec7942dfe2 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:41.279931 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e5b5-fefb-4769-b1f6-fc5ee7b5f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:41.280507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e5b5-fefb-4769-b1f6-fc5ee7b5f174 admin admin] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.280779 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e5b5-fefb-4769-b1f6-fc5ee7b5f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.281040 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e5b5-fefb-4769-b1f6-fc5ee7b5f174 admin admin] PATH_INFO: `/v3/projects` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.281748 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e5b5-fefb-4769-b1f6-fc5ee7b5f174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:41.283667 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e5b5-fefb-4769-b1f6-fc5ee7b5f174 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:41.307353 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1432/2861] 10.222.0.93 () {60 vars in 1152 bytes} [Wed May 11 19:06:41 2022] POST /identity/v3/projects => generated 363 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:41.311490 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:41.324094 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5609b83-d280-43a8-ab65-4d29f5ed4a23 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:41.384779 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5bd7e-febf-40da-a1b0-fc819bd768b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:41.385440 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5bd7e-febf-40da-a1b0-fc819bd768b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.385717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5bd7e-febf-40da-a1b0-fc819bd768b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.385985 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5bd7e-febf-40da-a1b0-fc819bd768b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.386668 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5bd7e-febf-40da-a1b0-fc819bd768b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:41.389154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5bd7e-febf-40da-a1b0-fc819bd768b1 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:41.407637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1430/2862] 10.222.0.93 () {60 vars in 1143 bytes} [Wed May 11 19:06:41 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 19:06:41.411802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e5b5-fefb-4769-b1f6-fc5ee7b5f174 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:41.422181 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e5b5-fefb-4769-b1f6-fc5ee7b5f174 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:41.426791 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205a6b5-df33-4ba6-9e19-fadf80ee388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:41.427466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205a6b5-df33-4ba6-9e19-fadf80ee388b admin admin] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.427754 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205a6b5-df33-4ba6-9e19-fadf80ee388b admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.428025 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205a6b5-df33-4ba6-9e19-fadf80ee388b admin admin] PATH_INFO: `/v3/roles` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.428741 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205a6b5-df33-4ba6-9e19-fadf80ee388b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:41.430333 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205a6b5-df33-4ba6-9e19-fadf80ee388b admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:41.444466 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1433/2863] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:41.451903 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5bd7e-febf-40da-a1b0-fc819bd768b1 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:41.462764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5bd7e-febf-40da-a1b0-fc819bd768b1 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:41.467458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca398f8d-1dd9-4cbf-9367-441349e74e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:41.468121 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398f8d-1dd9-4cbf-9367-441349e74e14 admin admin] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.468404 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398f8d-1dd9-4cbf-9367-441349e74e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.468686 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca398f8d-1dd9-4cbf-9367-441349e74e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.469415 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca398f8d-1dd9-4cbf-9367-441349e74e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:41.470995 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca398f8d-1dd9-4cbf-9367-441349e74e14 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:41.480827 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1431/2864] 10.222.0.93 () {58 vars in 1121 bytes} [Wed May 11 19:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 19:06:41.485129 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205a6b5-df33-4ba6-9e19-fadf80ee388b admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:41.494976 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205a6b5-df33-4ba6-9e19-fadf80ee388b admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:41.500108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:41.500977 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] REQUEST_METHOD: `PUT` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.501258 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.501531 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] PATH_INFO: `/v3/projects/53c6e1c101f54a078a0dbc178fd91ca3/users/d52fe5538b294257a0a876ccef561591/roles/39757d16971a48b6836913cd1908f48e` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.516415 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c6e1c101f54a078a0dbc178fd91ca3, user_id=d52fe5538b294257a0a876ccef561591, role_id=39757d16971a48b6836913cd1908f48e)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:41.519055 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:41.531706 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1434/2865] 10.222.0.93 () {60 vars in 1482 bytes} [Wed May 11 19:06:41 2022] PUT /identity/v3/projects/53c6e1c101f54a078a0dbc178fd91ca3/users/d52fe5538b294257a0a876ccef561591/roles/39757d16971a48b6836913cd1908f48e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:06:41.542705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e7d8-db21-46c2-a8fd-f8b7c544eeeb None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.543000 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e7d8-db21-46c2-a8fd-f8b7c544eeeb None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.543272 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e7d8-db21-46c2-a8fd-f8b7c544eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.570700 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-cc59e7d8-db21-46c2-a8fd-f8b7c544eeeb None None] MFA Rules not processed for user `d52fe5538b294257a0a876ccef561591`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:06:41.572014 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-cc59e7d8-db21-46c2-a8fd-f8b7c544eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:41.636534 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1432/2866] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:06:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:06:41.648091 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:06:41.649794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:06:41.706647 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174176-a8b4-4aac-91b1-c458b7184447 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:06:41.710318 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193a67-47ba-4c8e-bb63-2c6174cfa119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:06:41.710969 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193a67-47ba-4c8e-bb63-2c6174cfa119 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:06:41.711251 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193a67-47ba-4c8e-bb63-2c6174cfa119 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:06:41.711559 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193a67-47ba-4c8e-bb63-2c6174cfa119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:06:41.720058 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef193a67-47ba-4c8e-bb63-2c6174cfa119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:06:41.721502 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef193a67-47ba-4c8e-bb63-2c6174cfa119 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:06:41.730209 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1435/2867] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:06:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:07:26.925486 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59e7d8-db21-46c2-a8fd-f8b7c544eeeb None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:07:26.991822 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59e7d8-db21-46c2-a8fd-f8b7c544eeeb None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:07:26.996514 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:07:26.997417 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:26.997705 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:26.997980 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] PATH_INFO: `/v3/users/d52fe5538b294257a0a876ccef561591` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:26.999917 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52fe5538b294257a0a876ccef561591)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:07:27.001198 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:07:27.049789 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52fe5538b294257a0a876ccef561591'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.056479 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52fe5538b294257a0a876ccef561591'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.057135 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52fe5538b294257a0a876ccef561591'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.064526 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52fe5538b294257a0a876ccef561591'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.065628 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52fe5538b294257a0a876ccef561591'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.084136 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1433/2868] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:07:26 2022] DELETE /identity/v3/users/d52fe5538b294257a0a876ccef561591 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:07:27.088628 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09ee8-dc59-432a-a548-4bea873349f7 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:27.089260 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09ee8-dc59-432a-a548-4bea873349f7 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:27.089384 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09ee8-dc59-432a-a548-4bea873349f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:27.108074 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-dcd09ee8-dc59-432a-a548-4bea873349f7 None None] MFA Rules not processed for user `2e7cd529baa6412fbb8c3f6158f7ed52`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:07:27.109280 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-dcd09ee8-dc59-432a-a548-4bea873349f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:27.165157 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1436/2869] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:07:27.175249 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:07:27.176659 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:27.233517 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530962a0-8e50-423c-b10e-b0f12dc73bc9 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:07:27.237735 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8ca1-1455-4bf7-b993-c498e83b6f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:07:27.238381 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8ca1-1455-4bf7-b993-c498e83b6f0a service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:27.238663 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8ca1-1455-4bf7-b993-c498e83b6f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:27.238937 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8ca1-1455-4bf7-b993-c498e83b6f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:27.248055 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c8ca1-1455-4bf7-b993-c498e83b6f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:07:27.249473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c8ca1-1455-4bf7-b993-c498e83b6f0a service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:07:27.259423 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1434/2870] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:07:27.512849 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09ee8-dc59-432a-a548-4bea873349f7 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:07:27.514372 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-dcd09ee8-dc59-432a-a548-4bea873349f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:27.526034 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09ee8-dc59-432a-a548-4bea873349f7 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:07:27.531275 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:07:27.532238 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:27.532438 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:27.532728 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] PATH_INFO: `/v3/projects/53c6e1c101f54a078a0dbc178fd91ca3` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:27.534459 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c6e1c101f54a078a0dbc178fd91ca3)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:07:27.536416 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:07:27.581477 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c6e1c101f54a078a0dbc178fd91ca3', 'request_id': 'req-a6a3323a-bf81-4aad-ad2e-43c015a422bc'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.588773 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c6e1c101f54a078a0dbc178fd91ca3', 'request_id': 'req-a6a3323a-bf81-4aad-ad2e-43c015a422bc'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.594199 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c6e1c101f54a078a0dbc178fd91ca3', 'request_id': 'req-a6a3323a-bf81-4aad-ad2e-43c015a422bc'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.605799 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] The token cache is being invalidate because project 53c6e1c101f54a078a0dbc178fd91ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:07:27.606022 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.606657 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:07:27.608227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1437/2871] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:07:27 2022] DELETE /identity/v3/projects/53c6e1c101f54a078a0dbc178fd91ca3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:07:42.719975 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf3ca-489c-4486-8767-349f3ed0d4ed None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:42.720528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf3ca-489c-4486-8767-349f3ed0d4ed None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:42.720528 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf3ca-489c-4486-8767-349f3ed0d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:42.737264 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-946cf3ca-489c-4486-8767-349f3ed0d4ed None None] MFA Rules not processed for user `36dbb1e903f24becaede7f26b06845e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:07:42.738473 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-946cf3ca-489c-4486-8767-349f3ed0d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:42.799512 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1435/2872] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:07:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:07:42.834348 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:07:42.835822 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:42.841229 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf3ca-489c-4486-8767-349f3ed0d4ed None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:07:42.842590 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-946cf3ca-489c-4486-8767-349f3ed0d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:42.891630 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3323a-bf81-4aad-ad2e-43c015a422bc admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:07:42.895165 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434c793-d42a-411f-8bfd-afa9cdb5bae4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1d39dd41c348cb9cfdde6fa15da315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:07:42.895840 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434c793-d42a-411f-8bfd-afa9cdb5bae4 service glance] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:42.896123 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434c793-d42a-411f-8bfd-afa9cdb5bae4 service glance] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:42.896398 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434c793-d42a-411f-8bfd-afa9cdb5bae4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:42.898173 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf3ca-489c-4486-8767-349f3ed0d4ed None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:07:42.898316 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-f434c793-d42a-411f-8bfd-afa9cdb5bae4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:42.901739 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:07:42.902365 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:42.902640 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:42.902909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:42.904637 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:42.967158 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434c793-d42a-411f-8bfd-afa9cdb5bae4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:07:42.968554 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434c793-d42a-411f-8bfd-afa9cdb5bae4 service glance] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:07:42.971727 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:07:42.973140 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:07:42.979738 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1438/2873] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:07:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:07:42.984145 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1436/2874] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:07:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:07:47.594253 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a88e-f5fc-486f-a7ae-d36797f93e90 None None] REQUEST_METHOD: `POST` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:47.594720 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a88e-f5fc-486f-a7ae-d36797f93e90 None None] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:47.594837 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a88e-f5fc-486f-a7ae-d36797f93e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:47.612464 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.auth.core [None req-7f15a88e-f5fc-486f-a7ae-d36797f93e90 None None] MFA Rules not processed for user `ead71051e3c548e7989007c8f5d0abc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:07:47.613668 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-7f15a88e-f5fc-486f-a7ae-d36797f93e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:47.669886 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1439/2875] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:07:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:07:48.391573 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:07:48.393451 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:48.463049 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160aace-b2c7-494b-bddf-f887c66497b4 service neutron] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:07:48.468028 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '911d21a666844fc399286e24c2892184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:07:48.468665 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:48.468943 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:48.469212 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:48.471657 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:48.483057 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:07:48.484661 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:07:48.494325 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1437/2876] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:07:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:07:50.224981 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a88e-f5fc-486f-a7ae-d36797f93e90 None None] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:07:50.235632 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a88e-f5fc-486f-a7ae-d36797f93e90 None None] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:07:50.240417 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:07:50.241067 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:07:50.241345 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:07:50.241625 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:07:50.243472 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:07:50.256671 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:07:50.258440 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:07:50.268175 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1440/2877] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:07:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:08:16.620461 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:08:16.623447 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:08:16.641024 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51999417-fa28-4ed8-94aa-fd197b9aede6 service placement] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:08:16.648023 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:08:16.648691 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:08:16.648971 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:08:16.649245 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:08:16.651118 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:08:16.664796 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:08:16.666405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:08:16.679530 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1438/2878] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:08:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 19:08:39.172682 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:08:39.174832 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:08:39.242407 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be5c8-de1f-4c0a-be97-1f20719ac476 service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:08:39.246787 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:08:39.247679 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:08:39.247957 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:08:39.248227 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] PATH_INFO: `/v3/users/36dbb1e903f24becaede7f26b06845e8` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:08:39.249405 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36dbb1e903f24becaede7f26b06845e8)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:08:39.251326 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:08:39.294470 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36dbb1e903f24becaede7f26b06845e8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.301046 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36dbb1e903f24becaede7f26b06845e8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.308913 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36dbb1e903f24becaede7f26b06845e8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.309603 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36dbb1e903f24becaede7f26b06845e8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.321191 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36dbb1e903f24becaede7f26b06845e8'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.327196 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1441/2879] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:08:39 2022] DELETE /identity/v3/users/36dbb1e903f24becaede7f26b06845e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:08:39.496570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:08:39.507372 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3914-4946-40cd-b5e7-df3dd753e9cf service nova] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:08:39.563186 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:08:39.564093 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:08:39.564375 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:08:39.564770 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] PATH_INFO: `/v3/projects/6d43929ef2a74d3fb50580db2b83d868` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:08:39.566570 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d43929ef2a74d3fb50580db2b83d868)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:08:39.568507 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:08:39.612800 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d43929ef2a74d3fb50580db2b83d868', 'request_id': 'req-3a946aae-8aef-4a62-a16c-1800a1c84bff'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.618183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d43929ef2a74d3fb50580db2b83d868', 'request_id': 'req-3a946aae-8aef-4a62-a16c-1800a1c84bff'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.625364 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d43929ef2a74d3fb50580db2b83d868', 'request_id': 'req-3a946aae-8aef-4a62-a16c-1800a1c84bff'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.636820 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] The token cache is being invalidate because project 6d43929ef2a74d3fb50580db2b83d868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:08:39.637100 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.637710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-3a946aae-8aef-4a62-a16c-1800a1c84bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:08:39.639227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1439/2880] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:08:39 2022] DELETE /identity/v3/projects/6d43929ef2a74d3fb50580db2b83d868 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:09:45.760150 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:09:45.761562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:09:45.844758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5970d4-3bcc-4728-9387-94595e3da047 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:09:45.890125 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae471a0d19b04d1daf634d6d2c73645a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:09:45.890770 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:09:45.891051 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:09:45.891346 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:09:45.893137 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:09:45.962908 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:09:45.964387 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:09:45.973802 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1442/2881] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:09:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:09:47.124678 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2e04-2120-4a52-be55-48f19dee51f9 None None] REQUEST_METHOD: `POST` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:09:47.125227 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2e04-2120-4a52-be55-48f19dee51f9 None None] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:09:47.125339 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c2e04-2120-4a52-be55-48f19dee51f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:09:47.143004 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.auth.core [None req-457c2e04-2120-4a52-be55-48f19dee51f9 None None] MFA Rules not processed for user `ead71051e3c548e7989007c8f5d0abc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 19:09:47.144243 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-457c2e04-2120-4a52-be55-48f19dee51f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:09:47.151717 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1440/2882] 10.222.0.93 () {58 vars in 957 bytes} [Wed May 11 19:09:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 19:09:47.460848 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:09:47.462343 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:09:47.520980 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ab459-d5bd-4c44-9fed-89da9c0d2219 service cinder] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:09:47.524586 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:09:47.525230 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:09:47.525507 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:09:47.525777 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:09:47.527533 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:09:47.536985 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:09:47.538422 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:09:47.546454 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1443/2883] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:09:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:10:00.553660 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c2e04-2120-4a52-be55-48f19dee51f9 None None] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:10:00.555184 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-457c2e04-2120-4a52-be55-48f19dee51f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:10:00.637405 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c2e04-2120-4a52-be55-48f19dee51f9 None None] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:10:00.643396 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:10:00.644211 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:10:00.644332 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:10:00.644583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:10:00.646909 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:10:00.659564 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:10:00.661194 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:10:00.671992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1441/2884] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:10:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:10:04.898072 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:10:04.899659 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:10:04.915992 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbe1ca-5f26-427e-83ed-5668c619969d service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:10:04.921535 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaff3fdfbc054b8f86a2f9aaa98a70cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:10:04.922185 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:10:04.922467 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:10:04.922740 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:10:04.924522 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:10:04.937520 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:10:04.939189 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:10:04.950267 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1444/2885] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:10:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:11:36.851870 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:11:36.853246 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:11:36.941031 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9aa7e-701c-4e83-82d4-bd348c3ad910 service nova] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:11:36.946071 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '911d21a666844fc399286e24c2892184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:11:36.946711 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:11:36.946992 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:11:36.947266 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:11:36.949333 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:11:36.961190 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:11:36.962710 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:11:36.972514 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1442/2886] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:11:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:11:46.419588 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:11:46.421039 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:11:46.454171 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138f1e1-1e50-47f9-b9c5-b0dc09b43c65 service nova] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:11:46.457781 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0204b62913420a90303c42dbded7aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:11:46.458940 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] REQUEST_METHOD: `GET` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:11:46.459218 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:11:46.459521 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:11:46.461276 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:11:46.539941 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:11:46.541390 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:11:46.559857 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1445/2887] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 19:11:52.588761 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:11:52.590285 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:11:52.605652 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8574-94dd-4e57-a46c-e2a3f5e85846 service placement] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:11:52.610548 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:11:52.611458 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:11:52.611740 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:11:52.612009 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] PATH_INFO: `/v3/users/ead71051e3c548e7989007c8f5d0abc0` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:11:52.613235 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead71051e3c548e7989007c8f5d0abc0)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:11:52.615554 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:11:52.666248 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead71051e3c548e7989007c8f5d0abc0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:52.673457 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead71051e3c548e7989007c8f5d0abc0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:52.674164 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead71051e3c548e7989007c8f5d0abc0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:52.682585 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead71051e3c548e7989007c8f5d0abc0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:52.683045 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead71051e3c548e7989007c8f5d0abc0'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:52.701718 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1443/2888] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:11:52 2022] DELETE /identity/v3/users/ead71051e3c548e7989007c8f5d0abc0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:11:52.878485 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:11:52.889997 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616b766-a374-4dd3-a7ba-a93b15dc962f service neutron] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:11:52.947862 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:11:52.948729 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:11:52.949006 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:11:52.949638 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] PATH_INFO: `/v3/projects/aaad8f4e0e0b41c4b227a090b8260f61` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:11:52.950821 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaad8f4e0e0b41c4b227a090b8260f61)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:11:52.952758 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:11:52.998351 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaad8f4e0e0b41c4b227a090b8260f61', 'request_id': 'req-334fea66-9fca-411d-b8b6-95d712867bc6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.006107 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaad8f4e0e0b41c4b227a090b8260f61', 'request_id': 'req-334fea66-9fca-411d-b8b6-95d712867bc6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.011826 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaad8f4e0e0b41c4b227a090b8260f61', 'request_id': 'req-334fea66-9fca-411d-b8b6-95d712867bc6'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.023250 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] The token cache is being invalidate because project aaad8f4e0e0b41c4b227a090b8260f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:11:53.023562 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.024195 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.025757 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1446/2889] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:11:52 2022] DELETE /identity/v3/projects/aaad8f4e0e0b41c4b227a090b8260f61 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:11:53.029806 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:11:53.031207 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:11:53.044269 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d6b83-408c-474e-9bb6-7189769dbd46 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:11:53.098347 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:11:53.099134 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:11:53.099446 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:11:53.099723 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] PATH_INFO: `/v3/users/4cc669c9f1f6442ca5fdc322c5be3e45` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:11:53.100931 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc669c9f1f6442ca5fdc322c5be3e45)` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:11:53.102829 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:11:53.147154 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc669c9f1f6442ca5fdc322c5be3e45'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.153788 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc669c9f1f6442ca5fdc322c5be3e45'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.154434 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc669c9f1f6442ca5fdc322c5be3e45'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.161441 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc669c9f1f6442ca5fdc322c5be3e45'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.162165 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.notifications [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc669c9f1f6442ca5fdc322c5be3e45'} {{(pid=79853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.178764 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1444/2890] 10.222.0.93 () {58 vars in 1223 bytes} [Wed May 11 19:11:53 2022] DELETE /identity/v3/users/4cc669c9f1f6442ca5fdc322c5be3e45 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:11:53.346979 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] Authenticating user token {{(pid=79852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:11:53.348512 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.fernet_utils [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:11:53.361964 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fea66-9fca-411d-b8b6-95d712867bc6 admin admin] Validating token access rules against request {{(pid=79852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:11:53.417591 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7cd529baa6412fbb8c3f6158f7ed52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639dcabe7cb941cc82eb0b4e6f620fd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:11:53.418448 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:11:53.418726 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:11:53.419003 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] PATH_INFO: `/v3/projects/93ac0659e3fd4c14923d75d2bb401596` {{(pid=79852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:11:53.420202 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ac0659e3fd4c14923d75d2bb401596)` {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:11:53.422102 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] RBAC: Authorization granted {{(pid=79852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:11:53.467794 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ac0659e3fd4c14923d75d2bb401596', 'request_id': 'req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.475439 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ac0659e3fd4c14923d75d2bb401596', 'request_id': 'req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.480757 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ac0659e3fd4c14923d75d2bb401596', 'request_id': 'req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1'} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.491830 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] The token cache is being invalidate because project 93ac0659e3fd4c14923d75d2bb401596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 19:11:53.492108 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.492716 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: DEBUG keystone.notifications [None req-d74bfbc6-c72d-4b6f-a312-49d0e32bb3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 19:11:53.494261 dv-cinder-755101-8-iscsi devstack@keystone.service[79852]: [pid: 79852|app: 0|req: 1447/2891] 10.222.0.93 () {58 vars in 1232 bytes} [Wed May 11 19:11:53 2022] DELETE /identity/v3/projects/93ac0659e3fd4c14923d75d2bb401596 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 19:16:49.373673 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] Authenticating user token {{(pid=79853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 19:16:49.375191 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:16:49.441998 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bb48e-6fd7-4af0-a1f8-22d290e0ee78 admin admin] Validating token access rules against request {{(pid=79853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 19:16:49.497945 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2c161-f426-49dc-a0d8-dc891e669c49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '911d21a666844fc399286e24c2892184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b016ff3f3e34751a814a9d91930e2d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 19:16:49.498583 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2c161-f426-49dc-a0d8-dc891e669c49 service placement] REQUEST_METHOD: `GET` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 19:16:49.498863 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2c161-f426-49dc-a0d8-dc891e669c49 service placement] SCRIPT_NAME: `/identity` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 19:16:49.499137 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2c161-f426-49dc-a0d8-dc891e669c49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 19:16:49.500908 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.fernet_utils [None req-05e2c161-f426-49dc-a0d8-dc891e669c49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 19:16:49.512183 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2c161-f426-49dc-a0d8-dc891e669c49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 19:16:49.513738 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2c161-f426-49dc-a0d8-dc891e669c49 service placement] RBAC: Authorization granted {{(pid=79853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 19:16:49.523892 dv-cinder-755101-8-iscsi devstack@keystone.service[79853]: [pid: 79853|app: 0|req: 1445/2892] 10.222.0.93 () {60 vars in 1365 bytes} [Wed May 11 19:16:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)